00010000:00010000:3.0F:1788330401.375850:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1788330401.691521:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792479872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330401.691628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1788330401.693698:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792479872 00000100:00100000:1.0:1788330401.693739:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792479872 00000100:00100000:1.0:1788330401.693847:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788330401.693861:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792479872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330401.693907:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330401.694032:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792479872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330401.694040:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0F:1788330401.694112:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330401.694248:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792479872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330402.207784:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792480000:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.207909:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.207988:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792480512:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208021:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.208047:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792481024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208071:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.208094:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792481536:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.208207:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792480512 00000100:00100000:0.0:1788330402.208219:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792480512 00000100:00100000:0.0:1788330402.208290:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792481024 00000100:00100000:0.0:1788330402.208293:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792481024 00000100:00100000:0.0:1788330402.208306:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792481536 00000100:00100000:0.0:1788330402.208309:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792481536 00000100:00100000:0.0:1788330402.208341:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788330402.208352:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792480512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208436:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792480512:12345-0@lo:400:kworker.0 Request processed in 84us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.208444:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788330402.208467:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330402.208473:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792481024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208512:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792481024:12345-0@lo:400:kworker.0 Request processed in 39us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.208518:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330402.208530:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330402.208535:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792481536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208584:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792481536:12345-0@lo:400:kworker.0 Request processed in 49us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.208590:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788330402.208622:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330402.208662:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792480512:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208674:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792481024:0@lo:400:kworker.0 00010000:00080000:0.0:1788330402.208686:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d40000 x1875199792481536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330402.208695:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792481536:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208754:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792480256:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.208818:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792480768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.208858:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792481280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.208901:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788330402.208908:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792480128:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.208953:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792480640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.208974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.208994:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792481152:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330402.209047:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792480256 00000100:00100000:0.0:1788330402.209060:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792480256 00000100:00100000:0.0:1788330402.209094:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792480768 00000100:00100000:0.0:1788330402.209097:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792480768 00000100:00100000:0.0:1788330402.209125:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788330402.209132:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792480256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209205:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792480256:12345-0@lo:400:kworker.0 Request processed in 73us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.209212:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788330402.209225:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330402.209231:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792480768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209257:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792480768:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.209262:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330402.209283:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792480128 00000100:00100000:0.0:1788330402.209287:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792480128 00000100:00100000:0.0:1788330402.209312:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792480640 00000100:00100000:0.0:1788330402.209314:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792480640 00000100:00100000:0.0:1788330402.209328:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788330402.209334:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792480128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209370:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792480128:12345-0@lo:400:kworker.0 Request processed in 36us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.209388:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788330402.209402:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788330402.209407:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792480640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209437:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792480640:12345-0@lo:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.209442:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788330402.209470:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792481280 00000100:00100000:0.0:1788330402.209474:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792481280 00000100:00100000:0.0:1788330402.209498:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792481152 00000100:00100000:0.0:1788330402.209502:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792481152 00000100:00100000:0.0:1788330402.209516:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330402.209521:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792481280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209553:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792481280:12345-0@lo:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.209558:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330402.209570:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788330402.209577:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792481152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209602:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792481152:12345-0@lo:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.209608:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788330402.209628:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330402.209633:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330402.209636:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330402.209662:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792480128:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209675:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792480640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209684:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792481152:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209695:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792480256:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209703:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792480768:0@lo:400:kworker.0 00010000:00080000:0.0:1788330402.209714:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc18000 x1875199792481280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330402.209724:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792481280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209801:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792480000 00000100:00100000:0.0:1788330402.209806:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792480000 00000100:00100000:0.0:1788330402.209844:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788330402.209851:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3649:x1875199792480000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.209890:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3649:x1875199792480000:12345-0@lo:400:kworker.0 Request processed in 39us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330402.209895:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788330402.209930:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792480000:0@lo:400:kworker.0 00000100:00100000:1.0:1788330402.210334:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792480384:0@lo:400:kworker.0 00000100:00100000:1.0:1788330402.210393:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330402.210439:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792480384 00000100:00100000:1.0:1788330402.210444:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792480384 00000100:00100000:1.0:1788330402.210485:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330402.210493:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792480384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330402.210533:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792480384:12345-0@lo:400:kworker.0 Request processed in 41us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330402.210539:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788330402.210560:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330402.210579:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788330402.210586:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99eefd32d500, transno 8589934596 00000004:00080000:1.0:1788330402.210599:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788330402.210620:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792480384:0@lo:400:kworker.0 00000100:00100000:1.0:1788330402.212525:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792480896:0@lo:400:kworker.0 00000100:00100000:1.0:1788330402.212614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330402.215223:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792480896 00000100:00100000:2.0:1788330402.215243:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792480896 00000100:00100000:2.0:1788330402.215325:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788330402.215338:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792480896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788330402.217369:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330402.217527:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792481408:0@lo:400:kworker.0 00000100:00100000:0.0:1788330402.218393:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792481664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330402.223238:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792480896:12345-0@lo:400:kworker.0 Request processed in 7888us (10609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330402.223256:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788330402.224557:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792481792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330402.229286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330402.229309:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330402.229413:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792481408 00000100:00100000:1.0:1788330402.229425:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792481408 00000100:00100000:3.0:1788330402.229554:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792481792 00000100:00100000:3.0:1788330402.229560:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792481792 00000100:00100000:3.0:1788330402.229616:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330402.229629:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792481792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330402.230277:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788330402.230290:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792481408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330402.230413:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792481408:12345-0@lo:400:kworker.0 Request processed in 127us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330402.230422:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788330402.230456:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330402.230513:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792481408:0@lo:400:kworker.0 00000100:00100000:1.0:1788330402.230555:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792480896:0@lo:400:kworker.0 00002000:00000024:3.0:1788330402.231005:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788330402.231069:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792481792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1442us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330402.231078:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330402.231839:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792481792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330402.232520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330402.232991:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792481664 00000100:00100000:1.0:1788330402.233002:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792481664 00000100:00100000:1.0:1788330402.233064:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788330402.233076:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792481664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330402.233101:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788330402.233195:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792481664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330402.233203:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000001:00080000:0.0:1788330402.233390:0:17083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1788330402.233409:0:17083:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99edc665c180 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:0.0:1788330402.233414:0:17083:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99edc742a100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99edc665ce40 00000020:00080000:0.0:1788330402.233418:0:17083:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99edc742a600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99edc73d5200 00000020:00080000:0.0:1788330402.233449:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:0.0:1788330402.233554:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788330402.233600:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792481664:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788330402.235527:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330402.235546:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330402.235555:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330402.235562:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330402.235569:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330402.235578:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330402.235604:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:2.0:1788330402.235608:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330402.235623:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330402.235629:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330402.396804:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330402.715445:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330402.715474:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792481920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330402.715570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330402.715646:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792481920 00000100:00100000:1.0:1788330402.715655:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792481920 00000100:00100000:1.0:1788330402.715720:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788330402.715731:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792481920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330402.715773:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330402.715832:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792481920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330402.715840:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788330402.715902:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792481920:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788330403.420331:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330403.617843:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788330403.742470:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792482048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330403.742571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330403.742660:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792482048 00000100:00100000:1.0:1788330403.742670:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792482048 00000100:00100000:1.0:1788330403.742730:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788330403.742757:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792482048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330403.742804:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788330403.742859:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792482048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330403.742867:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788330403.743287:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792482048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330403.747678:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792482176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330403.747796:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330403.747898:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792482176 00000100:00100000:1.0:1788330403.747908:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792482176 00000100:00100000:1.0:1788330403.747973:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330403.747983:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792482176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330403.748034:0:19787:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788330403.748094:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792482176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330403.748112:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330403.748192:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792482176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330403.908569:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330403.908686:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766180864 00000100:00100000:0.0:1788330403.908704:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766180864 00000100:00100000:0.0:1788330403.908797:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:0.0:1788330403.908809:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+13:15588:x1875199766180864:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788330403.908947:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+13:15588:x1875199766180864:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 Request processed in 139us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330403.908956:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00080000:0.0:1788330403.908994:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330403.921320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330403.921433:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766180992 00000100:00100000:0.0:1788330403.921447:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766180992 00000100:00100000:0.0:1788330403.921528:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:0.0:1788330403.921542:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:15588:x1875199766180992:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788330403.921794:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:15588:x1875199766180992:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 Request processed in 254us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330403.921805:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00080000:0.0:1788330403.921839:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330403.941415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330403.941562:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766181248 00000100:00100000:3.0:1788330403.941576:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766181248 00000100:00100000:3.0:1788330403.941665:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:3.0:1788330403.941679:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+13:15588:x1875199766181248:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788330403.942001:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+14:15588:x1875199766181248:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 323us (607us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788330403.942011:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00010000:00010000:3.0:1788330404.445082:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330404.583310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330404.583376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330404.583421:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330404.583560:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766181632 00000100:00100000:2.0:1788330404.583575:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766181632 00000100:00100000:2.0:1788330404.583668:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766181504 00000100:00100000:2.0:1788330404.583672:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766181504 00000100:00100000:2.0:1788330404.583696:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:2.0:1788330404.583708:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2410:x1875199766181632:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330404.583931:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:3.0:1788330404.583942:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+14:2410:x1875199766181504:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330404.584052:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+14:2410:x1875199766181504:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 112us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330404.584079:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2410:x1875199766181632:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 373us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330404.584087:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:0.0:1788330404.584216:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766181376 00000100:00100000:0.0:1788330404.584222:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766181376 00000100:00100000:0.0:1788330404.584257:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:0.0:1788330404.584265:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2410:x1875199766181376:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330404.584301:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2410:x1875199766181376:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 38us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330404.584309:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:3.0:1788330404.586141:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:3.0:1788330404.587196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330404.587246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330404.587276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330404.587406:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766181888 00000100:00100000:1.0:1788330404.587418:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766181888 00000100:00100000:1.0:1788330404.587504:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1788330404.587518:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2410:x1875199766181888:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330404.587632:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2410:x1875199766181888:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 118us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330404.587640:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00080000:1.0:1788330404.587663:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330404.588071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330404.588099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330404.588123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330404.588146:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766181760 00000100:00100000:3.0:1788330404.588183:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766181760 00000100:00100000:3.0:1788330404.588222:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766182272 00000100:00100000:3.0:1788330404.588225:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766182272 00000100:00100000:3.0:1788330404.588238:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766182400 00000100:00100000:3.0:1788330404.588240:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766182400 00000100:00100000:3.0:1788330404.588255:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:3.0:1788330404.588263:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2409:x1875199766181760:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:3.0:1788330404.588290:0:18612:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd24ed 00000100:00080000:3.0:1788330404.588307:0:18612:0:(import.c:65:import_set_state_nolock()) ffff99eeded7f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330404.588371:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1788330404.588936:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330404.588959:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:1.0:1788330404.588973:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2409:x1875199766182272:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:1.0:1788330404.588999:0:18610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd252c 00000100:00080000:1.0:1788330404.589007:0:18610:0:(import.c:65:import_set_state_nolock()) ffff99edc5da5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788330404.589043:0:18610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788330404.589429:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+2:2409:x1875199766181760:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 1161us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330404.589439:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:3.0:1788330404.589476:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:3.0:1788330404.589484:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2409:x1875199766182400:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:3.0:1788330404.589500:0:18612:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2533 00000100:00080000:3.0:1788330404.589508:0:18612:0:(import.c:65:import_set_state_nolock()) ffff99edc5da0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330404.589537:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788330404.589654:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+2:2409:x1875199766182400:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 170us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330404.589661:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00010000:00010000:3.0:1788330404.589680:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330404.591430:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766182016 00000100:00100000:2.0:1788330404.592338:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766182016 00000100:00100000:3.0:1788330404.592542:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766182144 00000100:00100000:3.0:1788330404.592547:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766182144 00000100:00100000:3.0:1788330404.592626:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:3.0:1788330404.592642:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2410:x1875199766182016:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330404.592781:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2410:x1875199766182016:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 144us (5534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330404.592789:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:3.0:1788330404.592815:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:3.0:1788330404.592822:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2410:x1875199766182144:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330404.592853:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2410:x1875199766182144:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 31us (5576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330404.592859:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:1.0:1788330404.593567:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+2:2409:x1875199766182272:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 4592us (5459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330404.593578:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00010000:00010000:1.0:1788330404.593730:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330404.593842:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330404.593848:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330404.593852:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330404.593855:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788330405.470626:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330406.495835:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330406.811701:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792482304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330406.811806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330406.812706:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792482304 00000100:00100000:1.0:1788330406.812735:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792482304 00000100:00100000:1.0:1788330406.812827:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788330406.812841:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792482304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330406.813137:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330406.813273:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792482304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 434us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330406.813282:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330406.813398:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792482304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788330406.813485:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788330407.067447:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788330407.067465:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330407.067490:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788330407.067503:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788330407.323542:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792482432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330407.323654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330407.323804:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792482432 00000100:00100000:1.0:1788330407.323816:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792482432 00000100:00100000:1.0:1788330407.323897:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788330407.323911:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792482432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330407.323948:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788330407.324017:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792482432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330407.324025:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788330407.324035:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330407.324114:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792482688:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.324169:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330407.324195:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792483200:0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.324209:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792482560:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.324221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330407.324247:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330407.324256:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792483712:0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.324268:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792483072:0@lo:400:kworker.0 00000100:00100000:1.0:1788330407.324318:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792482688 00000100:00100000:1.0:1788330407.324323:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792482688 00000100:00100000:1.0:1788330407.324364:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788330407.324372:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792482688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330407.324685:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792482944:0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.337943:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330407.338042:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792483584:0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.338089:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330407.338178:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792484096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330407.338210:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330407.338283:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792482560 00000100:00100000:0.0:1788330407.338294:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792482560 00000100:00100000:0.0:1788330407.338382:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788330407.338395:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3649:x1875199792482560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.338901:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3649:x1875199792482560:12345-0@lo:400:kworker.0 Request processed in 495us (14639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330407.338913:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788330407.339076:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792484096 00000100:00100000:0.0:1788330407.339082:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792484096 00000100:00100000:0.0:1788330407.339133:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330407.339141:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792484096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330407.339184:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788330407.339223:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792484096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330407.339230:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788330407.339252:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330407.339300:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792484096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330407.339314:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792482560:0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.339388:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792483072 00000100:00100000:0.0:1788330407.339393:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792483072 00000100:00100000:0.0:1788330407.339415:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788330407.339422:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792483072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.339483:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792483072:12345-0@lo:400:kworker.0 Request processed in 60us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330407.339503:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788330407.339535:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792483072:0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.339597:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792482816:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.339625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330407.339633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330407.339655:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.339662:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792483584 00000100:00100000:3.0:1788330407.339666:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792483584 00000100:00100000:0.0:1788330407.339675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330407.339691:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792483840:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.339705:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792483712 00000100:00100000:3.0:1788330407.339709:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792483712 00000100:00100000:0.0:1788330407.339712:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330407.339723:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792483840 00000100:00100000:3.0:1788330407.339725:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792483840 00000100:00100000:3.0:1788330407.339741:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788330407.339746:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788330407.339748:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792483584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.339752:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792483712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.339782:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792483712:12345-0@lo:400:kworker.0 Request processed in 30us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330407.339785:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792483584:12345-0@lo:400:kworker.0 Request processed in 39us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330407.339789:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788330407.339792:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788330407.339803:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788330407.339808:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792483840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.339843:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792483840:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330407.340172:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792483200 00000100:00100000:3.0:1788330407.340178:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792483200 00000100:00100000:3.0:1788330407.340213:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792482816 00000100:00100000:3.0:1788330407.340217:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792482816 00000100:00100000:3.0:1788330407.340229:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792483328 00000100:00100000:3.0:1788330407.340231:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792483328 00000100:00100000:3.0:1788330407.340243:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330407.340250:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792483200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.340308:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792483200:12345-0@lo:400:kworker.0 Request processed in 58us (16085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330407.340315:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330407.340338:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788330407.340338:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788330407.340345:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792482816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.340379:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792483840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.340414:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330407.340422:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792483328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330407.340481:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792483328:12345-0@lo:400:kworker.0 Request processed in 60us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330407.340502:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330407.340529:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.340558:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792482816:12345-0@lo:400:kworker.0 Request processed in 214us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330407.340570:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792482816:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.340575:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788330407.340591:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330407.340597:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330407.340600:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330407.340624:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792483584:0@lo:400:kworker.0 00010000:00080000:3.0:1788330407.340626:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fd500 x1875199792483712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330407.340637:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792483712:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.340659:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792483200:0@lo:400:kworker.0 00000100:00100000:1.0:1788330407.342221:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792482688:12345-0@lo:400:kworker.0 Request processed in 17834us (18035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330407.342239:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788330407.342312:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792482688:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.343922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330407.343987:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792483456:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.344026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330407.344066:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792483968:0@lo:400:kworker.0 00000100:00100000:3.0:1788330407.345033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330407.345127:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792482432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330407.345485:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792482944 00000100:00100000:2.0:1788330407.345496:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792482944 00000100:00100000:2.0:1788330407.345563:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792483456 00000100:00100000:2.0:1788330407.345567:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792483456 00000100:00100000:2.0:1788330407.345579:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792483968 00000100:00100000:2.0:1788330407.345582:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792483968 00000100:00100000:2.0:1788330407.345618:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788330407.345646:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792482944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330407.345745:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792482944:12345-0@lo:400:kworker.0 Request processed in 101us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330407.345754:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788330407.345775:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788330407.345781:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792483456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330407.345811:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792483456:12345-0@lo:400:kworker.0 Request processed in 30us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330407.345818:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788330407.345830:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788330407.345837:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792483968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330407.345865:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792483968:12345-0@lo:400:kworker.0 Request processed in 29us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330407.345871:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788330407.345889:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330407.345916:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792482944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330407.345929:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792483456:0@lo:400:kworker.0 00010000:00080000:2.0:1788330407.345943:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72ff100 x1875199792483968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330407.345954:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792483968:0@lo:400:kworker.0 00010000:00010000:1.0:1788330407.515737:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330407.836399:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792484224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330407.836477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330407.836694:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792484224 00000100:00100000:1.0:1788330407.836703:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792484224 00000100:00100000:1.0:1788330407.836758:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788330407.836768:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792484224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330407.836810:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330407.844175:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792484224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7373us (7663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330407.844192:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788330407.844989:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792484224:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1788330407.855596:0:17083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1788330407.855622:0:17083:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:0.0:1788330407.855713:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:0.0:1788330407.855732:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000001:02000400:2.0:1788330408.162658:0:20482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 02:26:46 (1788330406) 00010000:00010000:1.0:1788330408.539671:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330408.859554:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792484480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330408.859643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330408.859996:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792484480 00000100:00100000:2.0:1788330408.860006:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792484480 00000100:00100000:2.0:1788330408.860064:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788330408.860075:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792484480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330408.860111:0:19787:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788330408.860198:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792484480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330408.860206:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330408.860292:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792484480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330408.860527:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330408.860538:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792484352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330408.860570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330408.860731:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792484352 00000100:00100000:1.0:1788330408.860736:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792484352 00000100:00100000:1.0:1788330408.860915:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788330408.860925:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792484352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330408.860947:0:17108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788330408.860993:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792484352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330408.861000:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330408.861056:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792484352:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788330409.563996:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330409.699746:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330409.699792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330409.699888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330409.699897:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766182528 00000100:00100000:2.0:1788330409.699910:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766182528 00000100:00100000:1.0:1788330409.699926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330409.699990:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330409.700007:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766182656 00000100:00100000:0.0:1788330409.700021:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766182656 00000100:00100000:3.0:1788330409.700025:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766182912 00000100:00100000:3.0:1788330409.700031:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766182912 00000100:00100000:2.0:1788330409.700072:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:2.0:1788330409.700085:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2413:x1875199766182528:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330409.700086:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766183168 00000100:00100000:0.0:1788330409.700092:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766183168 00000100:00100000:2.0:1788330409.700216:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2413:x1875199766182528:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 135us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330409.700224:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:1.0:1788330409.700456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330409.700483:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766182784 00000100:00100000:1.0:1788330409.700487:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766182784 00000100:00100000:3.0:1788330409.701405:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:3.0:1788330409.701417:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2412:x1875199766182912:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330409.701483:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2412:x1875199766182912:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 69us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330409.701511:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:0.0:1788330409.701654:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766183040 00000100:00100000:0.0:1788330409.701661:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766183040 00000100:00100000:0.0:1788330409.701689:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:0.0:1788330409.701698:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+13:2413:x1875199766182656:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330409.701741:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+13:2413:x1875199766182656:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 46us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330409.701748:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:0.0:1788330409.701767:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 93 00000100:00100000:0.0:1788330409.701782:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2412:x1875199766183168:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330409.701819:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2412:x1875199766183168:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 39us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330409.701825:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 93 00000100:00100000:0.0:1788330409.701841:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00100000:0.0:1788330409.701847:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2412:x1875199766183040:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330409.701886:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2412:x1875199766183040:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 40us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330409.701891:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00080000:2.0:1788330409.702014:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330409.702020:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330409.702022:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330409.702130:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:1.0:1788330409.702138:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2412:x1875199766182784:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330409.702173:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2412:x1875199766182784:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 37us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330409.702178:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 95 00000001:00100000:2.0:1788330409.888384:0:18607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14374cd5-fe9e-406e-8acf-b98a60f93e29 00000020:00000080:2.0:1788330409.888394:0:18607:0:(genops.c:885:class_export_put()) final put ffff99edc5da7800/14374cd5-fe9e-406e-8acf-b98a60f93e29 00000001:00100000:2.0:1788330409.888423:0:18607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000020:00000080:2.0:1788330409.888426:0:18607:0:(genops.c:885:class_export_put()) final put ffff99eeded7a000/99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000020:00000080:0.0:1788330409.888485:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5da7800/14374cd5-fe9e-406e-8acf-b98a60f93e29 for lustre-OST0000 00000020:00000080:0.0:1788330409.888542:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eeded7a000/99dd523a-1cb7-4908-afb4-ee09ad740fbd for lustre-OST0000 00000020:00000080:0.0:1788330409.888575:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5da5800 for lustre-OST0000 00000020:00000080:0.0:1788330409.888582:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eeded7f800 for lustre-OST0000 00000001:00100000:2.0:1788330409.890239:0:19426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14374cd5-fe9e-406e-8acf-b98a60f93e29 00000020:00000080:2.0:1788330409.890263:0:19426:0:(genops.c:885:class_export_put()) final put ffff99edc5da6000/14374cd5-fe9e-406e-8acf-b98a60f93e29 00000020:00000080:0.0:1788330409.890446:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5da6000/14374cd5-fe9e-406e-8acf-b98a60f93e29 for lustre-OST0001 00000020:00000080:0.0:1788330409.890610:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5da0800 for lustre-OST0001 00010000:00010000:1.0:1788330410.587579:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330411.449935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330411.450068:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766183424 00000100:00100000:2.0:1788330411.450080:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766183424 00000100:00100000:2.0:1788330411.451761:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:2.0:1788330411.451780:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+13:16349:x1875199766183424:12345-192.168.202.50@tcp:35:umount.0 00000001:00080000:2.0:1788330411.452066:0:17107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788330411.452200:0:17107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1788330411.452358:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+16:16349:x1875199766183424:12345-192.168.202.50@tcp:35:umount.0 Request processed in 582us (2432us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788330411.452369:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000020:00080000:2.0:1788330411.452375:0:17107:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:0.0:1788330411.452999:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330411.461498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330411.461586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330411.461629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330411.461670:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330411.461717:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766183936 00000100:00100000:3.0:1788330411.461729:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766183936 00000100:00100000:3.0:1788330411.461795:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:3.0:1788330411.461806:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2409:x1875199766183936:12345-192.168.202.50@tcp:9:umount.0 00000020:00000080:3.0:1788330411.461842:0:18802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd24f4 00000100:00080000:3.0:1788330411.461852:0:18802:0:(import.c:65:import_set_state_nolock()) ffff99eeded7f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330411.461904:0:18802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788330411.462057:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+2:2409:x1875199766183936:12345-192.168.202.50@tcp:9:umount.0 Request processed in 252us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330411.462065:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:1.0:1788330411.462507:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766183552 00000100:00100000:1.0:1788330411.462521:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766183552 00000100:00100000:1.0:1788330411.462565:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766183808 00000100:00100000:1.0:1788330411.462569:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766183808 00000100:00100000:1.0:1788330411.462588:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766183680 00000100:00100000:1.0:1788330411.462591:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766183680 00000100:00100000:1.0:1788330411.462608:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1788330411.462616:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+15:2413:x1875199766183552:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330411.462629:0:20133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330411.462652:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd24ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061de expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330411.462671:0:20133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330411.462699:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+14:2413:x1875199766183552:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 84us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330411.462705:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1788330411.462720:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:1.0:1788330411.462727:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2413:x1875199766183808:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330411.462740:0:20133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330411.462750:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9038200/0x8475908e9fd2556 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062c5 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330411.462761:0:20133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330411.462779:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:2413:x1875199766183808:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 52us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330411.462785:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:1.0:1788330411.462797:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:1.0:1788330411.462815:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd762c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:2413:x1875199766183680:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330411.462822:0:20133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330411.462831:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9039c00/0x8475908e9fd24d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610620f expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330411.462840:0:20133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788330411.462854:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330411.462856:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd762c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:2413:x1875199766183680:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 43us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330411.462861:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00010000:00010000:2.0:1788330411.462875:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330411.473301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330411.473403:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766184832 00000100:00100000:0.0:1788330411.473420:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766184832 00000100:00100000:0.0:1788330411.473525:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:0.0:1788330411.473537:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+16:2409:x1875199766184832:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:0.0:1788330411.473578:0:17103:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd24df 00000020:00010000:0.0:1788330411.473595:0:17103:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99eededf3800: total 0 00000100:00080000:0.0:1788330411.473600:0:17103:0:(import.c:65:import_set_state_nolock()) ffff99edc5f72800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330411.473635:0:17103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1788330411.473802:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+15:2409:x1875199766184832:12345-192.168.202.50@tcp:39:umount.0 Request processed in 267us (522us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788330411.473831:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000020:00010000:3.0:1788330411.473901:0:17858:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99eededf3800: total 0 00010000:00010000:3.0:1788330411.473905:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330411.473961:0:17858:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99eededf3800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788330411.474001:0:17858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:3.0:1788330411.475367:0:17858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788330411.475383:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106335 expref: 14 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330411.475478:0:17858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99edc10b5400) 00010000:00010000:2.0:1788330411.475482:0:17858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330411.475487:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd25c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062d3 expref: 13 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330411.475509:0:17858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:2.0:1788330411.475511:0:17858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330411.475527:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd2605 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062e1 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330411.475541:0:17858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:2.0:1788330411.475543:0:17858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330411.475547:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2794 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610635f expref: 11 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330411.475562:0:17858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:2.0:1788330411.475581:0:17858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330411.475586:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610637b expref: 10 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330411.475601:0:17858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99edc10b5b00) 00010000:00010000:2.0:1788330411.475603:0:17858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330411.475606:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd25aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062cc expref: 9 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330411.475620:0:17858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:2.0:1788330411.475622:0:17858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788330411.475626:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd268a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610630b expref: 8 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330411.475638:0:17858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:2.0:1788330411.475640:0:17858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330411.475643:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 7 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330411.475656:0:17858:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99eededf3800, canceled 8 locks, left on hash table 0. 00010000:00010000:2.0:1788330411.475687:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330411.475689:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330411.475691:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330411.479676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330411.479739:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766184960 00000100:00100000:0.0:1788330411.479749:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766184960 00000100:00100000:0.0:1788330411.479810:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:0.0:1788330411.479818:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2409:x1875199766184960:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:0.0:1788330411.479848:0:18635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd24e6 00000100:00080000:0.0:1788330411.479860:0:18635:0:(import.c:65:import_set_state_nolock()) ffff99eeded7d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330411.479889:0:18635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788330411.480084:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+3:2409:x1875199766184960:12345-192.168.202.50@tcp:39:umount.0 Request processed in 267us (420us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788330411.480090:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00080000:2.0:1788330411.480186:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788330411.480381:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330411.611772:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330411.932930:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792484608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330411.933011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330411.933327:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792484608 00000100:00100000:1.0:1788330411.933338:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792484608 00000100:00100000:1.0:1788330411.933413:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788330411.933424:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792484608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330411.933464:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330411.933533:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792484608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330411.933541:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788330411.934018:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330411.934060:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792484608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330412.443976:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330412.444002:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792484736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330412.444080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330412.444830:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792484992:0@lo:400:kworker.0 00000100:00100000:0.0:1788330412.444872:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330412.444901:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792485504:0@lo:400:kworker.0 00000100:00100000:0.0:1788330412.444953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330412.444973:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792486016:0@lo:400:kworker.0 00000100:00100000:0.0:1788330412.444999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330412.445022:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788330412.445028:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792485120:0@lo:400:kworker.0 00000100:00100000:0.0:1788330412.445050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330412.445075:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792485632:0@lo:400:kworker.0 00000100:00100000:0.0:1788330412.445097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330412.445112:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792486144:0@lo:400:kworker.0 00000100:00100000:0.0:1788330412.445130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330412.445199:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792484992 00000100:00100000:0.0:1788330412.445207:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792484992 00000100:00100000:0.0:1788330412.445268:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330412.445289:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792484992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.445494:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792485504 00000100:00100000:3.0:1788330412.445504:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792485504 00000100:00100000:3.0:1788330412.445551:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792485120 00000100:00100000:3.0:1788330412.445555:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792485120 00000100:00100000:3.0:1788330412.445566:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792485632 00000100:00100000:3.0:1788330412.445568:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792485632 00000100:00100000:3.0:1788330412.445583:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330412.445589:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792485504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.445640:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792485504:12345-0@lo:400:kworker.0 Request processed in 51us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330412.445647:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330412.445664:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330412.445669:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792485120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.445696:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792485120:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330412.445703:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330412.445715:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788330412.445721:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792485632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.445959:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792485632:12345-0@lo:400:kworker.0 Request processed in 238us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330412.445966:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788330412.446003:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792485248:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.446029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330412.446052:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792485760:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.446075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330412.446092:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792486272:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.446111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330412.446134:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788330412.446141:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792484864:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.446191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330412.446218:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792485376:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.446255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330412.446272:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792485888:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.446303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788330412.446338:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330412.446342:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330412.446372:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792485120:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.446384:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792485632:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.446394:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792485504:0@lo:400:kworker.0 00000100:00100000:1.0:1788330412.446699:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792485376 00000100:00100000:1.0:1788330412.446704:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792485376 00000100:00100000:1.0:1788330412.446818:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788330412.446827:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792485376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330412.446892:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792485376:12345-0@lo:400:kworker.0 Request processed in 67us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330412.446899:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788330412.446924:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792486016 00000100:00100000:1.0:1788330412.446928:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792486016 00000100:00100000:1.0:1788330412.446978:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792486144 00000100:00100000:1.0:1788330412.446982:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792486144 00000100:00100000:1.0:1788330412.446996:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792485248 00000100:00100000:1.0:1788330412.446999:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792485248 00000100:00100000:1.0:1788330412.447010:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792485760 00000100:00100000:1.0:1788330412.447012:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792485760 00000100:00100000:1.0:1788330412.447023:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792486272 00000100:00100000:1.0:1788330412.447026:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792486272 00000100:00100000:1.0:1788330412.447039:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792485888 00000100:00100000:1.0:1788330412.447041:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792485888 00000100:00100000:1.0:1788330412.447057:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788330412.447063:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792486016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330412.447099:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792486016:12345-0@lo:400:kworker.0 Request processed in 36us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330412.447105:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788330412.447118:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788330412.447123:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792486144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330412.447199:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792486144:12345-0@lo:400:kworker.0 Request processed in 76us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330412.447205:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788330412.447218:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788330412.447224:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792485248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330412.447254:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792485248:12345-0@lo:400:kworker.0 Request processed in 31us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330412.447259:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788330412.447271:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788330412.447287:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792485760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330412.447316:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792485760:12345-0@lo:400:kworker.0 Request processed in 39us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330412.447340:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788330412.447354:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788330412.447360:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792486272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330412.447390:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792486272:12345-0@lo:400:kworker.0 Request processed in 31us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330412.447396:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788330412.447803:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788330412.447818:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792485888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330412.447855:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792485888:12345-0@lo:400:kworker.0 Request processed in 40us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330412.447861:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788330412.447911:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792486400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330412.447946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330412.448002:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792484736 00000100:00100000:2.0:1788330412.448008:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792484736 00000100:00100000:2.0:1788330412.448033:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792486400 00000100:00100000:2.0:1788330412.448036:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792486400 00000100:00100000:2.0:1788330412.448049:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788330412.448055:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792484736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330412.448083:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788330412.448122:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792484736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (4043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330412.448129:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788330412.448142:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330412.448170:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792486400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330412.448180:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788330412.448203:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792486400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330412.448209:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330412.448260:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792486400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330412.448287:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792484736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330412.448353:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792485376:0@lo:400:kworker.0 00000100:00100000:2.0:1788330412.448376:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792485888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330412.448387:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792485248:0@lo:400:kworker.0 00000100:00100000:2.0:1788330412.448397:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792485760:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.451720:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792486144:0@lo:400:kworker.0 00000100:00100000:0.0:1788330412.451889:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792484992:12345-0@lo:400:kworker.0 Request processed in 6609us (7013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330412.451900:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330412.451967:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792484864 00000100:00100000:0.0:1788330412.451975:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792484864 00000100:00100000:0.0:1788330412.452034:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788330412.452044:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3646:x1875199792484864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330412.452102:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3646:x1875199792484864:12345-0@lo:400:kworker.0 Request processed in 60us (5910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330412.452108:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1788330412.452195:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330412.452200:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330412.452203:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788330412.452967:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6607b80 x1875199792486272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330412.452984:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792486272:0@lo:400:kworker.0 00000100:00100000:2.0:1788330412.453037:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792484864:0@lo:400:kworker.0 00000100:00100000:3.0:1788330412.453128:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792484992:0@lo:400:kworker.0 00010000:00080000:3.0:1788330412.453143:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffd69f80 x1875199792486016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330412.453179:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792486016:0@lo:400:kworker.0 00010000:00010000:2.0:1788330412.636687:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330412.956117:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330412.956141:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792486528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330412.956231:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330412.956701:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792486528 00000100:00100000:1.0:1788330412.956713:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792486528 00000100:00100000:1.0:1788330412.956773:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788330412.956784:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792486528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330412.956812:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330412.956882:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792486528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330412.956890:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788330412.956991:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792486528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330413.394384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330413.394447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330413.394544:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766185088 00000100:00100000:1.0:1788330413.394556:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766185088 00000100:00100000:1.0:1788330413.394620:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766185216 00000100:00100000:1.0:1788330413.394624:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766185216 00000100:00100000:1.0:1788330413.394658:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1788330413.394668:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:2412:x1875199766185088:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330413.394684:0:20133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330413.394705:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ef600/0x8475908e9fd2509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610624e expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330413.394723:0:20133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330413.394773:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:2412:x1875199766185088:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 107us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330413.394799:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1788330413.394817:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:1.0:1788330413.394823:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+9:2412:x1875199766185216:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330413.394831:0:20133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330413.394840:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e78600/0x8475908e9fd2510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610627f expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330413.394849:0:20133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330413.394867:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:2412:x1875199766185216:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 44us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330413.394873:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:1.0:1788330413.404929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330413.405103:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766185344 00000100:00100000:0.0:1788330413.405115:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766185344 00000100:00100000:0.0:1788330413.405227:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1788330413.405238:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:2413:x1875199766185344:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330413.405297:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330413.405333:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ee600/0x8475908e9fd254f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062be expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330413.405355:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330413.405423:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+7:2413:x1875199766185344:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 186us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330413.405440:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:3.0:1788330413.422814:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330413.423320:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766185600 00000100:00100000:2.0:1788330413.423331:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766185600 00000100:00100000:2.0:1788330413.423420:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:2.0:1788330413.423432:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2409:x1875199766185600:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:2.0:1788330413.423494:0:18635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd251e 00000020:00010000:2.0:1788330413.423503:0:18635:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99edc5da4800: total 0 00000100:00080000:2.0:1788330413.423507:0:18635:0:(import.c:65:import_set_state_nolock()) ffff99edc5da0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330413.423536:0:18635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1788330413.423704:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2409:x1875199766185600:12345-192.168.202.50@tcp:39:umount.0 Request processed in 273us (902us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788330413.423713:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00080000:0.0:1788330413.424529:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788330413.424762:0:17091:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99edc5da4800: total 0 00010000:00010000:3.0:1788330413.424828:0:17091:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99edc5da4800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788330413.424861:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:3.0:1788330413.424864:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330413.424875:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2613 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062e8 expref: 4 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330413.424915:0:17091:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99edc5da4800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788330413.424928:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330413.424930:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330413.424932:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330413.434469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330413.434619:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766185728 00000100:00100000:0.0:1788330413.434631:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766185728 00000100:00100000:0.0:1788330413.434716:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:0.0:1788330413.434728:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2409:x1875199766185728:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:0.0:1788330413.434768:0:17103:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2525 00000100:00080000:0.0:1788330413.434778:0:17103:0:(import.c:65:import_set_state_nolock()) ffff99eeded7e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330413.434806:0:17103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788330413.434965:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+3:2409:x1875199766185728:12345-192.168.202.50@tcp:39:umount.0 Request processed in 238us (505us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788330413.434973:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00080000:3.0:1788330413.435429:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788330413.435684:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330413.476620:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330413.476715:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766185984 00000100:00100000:0.0:1788330413.476725:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766185984 00000100:00100000:0.0:1788330413.476781:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 176 00000100:00100000:0.0:1788330413.476790:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc661f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+7:2409:x1875199766185984:12345-192.168.202.50@tcp:251:umount.0 00000020:00000080:0.0:1788330413.476835:0:17097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd24bc 00000020:00010000:0.0:1788330413.476844:0:17097:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99edc5da5000: total 0 00000100:00080000:0.0:1788330413.476849:0:17097:0:(import.c:65:import_set_state_nolock()) ffff99edc5da2000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788330413.476924:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc661f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+3:2409:x1875199766185984:12345-192.168.202.50@tcp:251:umount.0 Request processed in 136us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330413.476955:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 176 00000020:00010000:3.0:1788330413.477712:0:17858:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99edc5da5000: total 0 00010000:00010000:3.0:1788330413.477767:0:17858:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99edc5da5000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788330413.477800:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91be00/0x8475908e9fd24c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061d7 expref: 2 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330413.477815:0:17858:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99edc5da5000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788330413.477823:0:17858:0:(genops.c:885:class_export_put()) final put ffff99edc5da5000/9ce3fcfa-33df-4730-b19b-df0f5c7a4b47 00010000:00010000:3.0:1788330413.477842:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330413.477845:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330413.477846:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788330413.477884:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5da5000/9ce3fcfa-33df-4730-b19b-df0f5c7a4b47 for MGS 00000020:00000080:1.0:1788330413.477922:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5da2000 for MGS 00010000:00010000:3.0:1788330413.660047:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330413.859938:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788330413.984192:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792486656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330413.984449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330413.984543:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792486656 00000100:00100000:1.0:1788330413.984551:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792486656 00000100:00100000:1.0:1788330413.984597:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788330413.984606:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792486656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330413.984643:0:17108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788330413.984689:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792486656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330413.984696:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788330413.984743:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792486656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330413.993625:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330413.993650:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792486784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330413.993718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330413.993853:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792486784 00000100:00100000:0.0:1788330413.993863:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792486784 00000100:00100000:0.0:1788330413.993921:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788330413.993940:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792486784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330413.993975:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330413.994024:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792486784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330413.994031:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788330413.994306:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792486784:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788330414.685446:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788330415.439478:0:20677:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788330415.457064:0:20677:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788330415.457126:0:20677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.457141:0:20677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.457174:0:20677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.457181:0:20677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.457198:0:20677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788330415.457204:0:20677:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788330415.457231:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788330415.457236:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788330415.457242:0:20677:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788330415.457277:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99eee7275800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788330415.457418:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330415.457426:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.457434:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330415.457438:0:17858:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.457447:0:17858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330415.457455:0:17858:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330415.457478:0:17858:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330415.457481:0:17858:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788330415.457483:0:17858:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788330415.457509:0:17858:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.457515:0:17858:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330415.457537:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.457544:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.457555:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330415.457556:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330415.457558:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330415.457564:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330415.457580:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792487040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330415.457640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330415.457692:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792487040 00000100:00100000:3.0:1788330415.457698:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792487040 00000100:00100000:3.0:1788330415.457740:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330415.457748:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3646:x1875199792487040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330415.457760:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330415.457772:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147be00/0x8475908e9fd2086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd207f expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.457784:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330415.457817:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:3646:x1875199792487040:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330415.457824:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330415.457858:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792487040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330415.457993:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792486912:0@lo:39:umount.0 00000100:00100000:3.0:1788330415.458027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330415.458273:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792486912 00000100:00100000:1.0:1788330415.458279:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792486912 00000100:00100000:1.0:1788330415.458321:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330415.458329:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875199792486912:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788330415.458350:0:18635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd20b0 00000100:00080000:1.0:1788330415.458364:0:18635:0:(import.c:65:import_set_state_nolock()) ffff99eee721a000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788330415.458436:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1875199792486912:12345-0@lo:39:umount.0 Request processed in 109us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330415.458443:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1788330415.458450:0:18635:0:(genops.c:885:class_export_put()) final put ffff99eef59c5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788330415.458475:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef59c5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788330415.458511:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eee721a000 for lustre-MDT0000 00010000:00010000:3.0:1788330415.458601:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330415.458622:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee7275800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788330415.458637:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792486912:0@lo:39:umount.0 00000100:00080000:1.0:1788330415.458728:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788330415.458731:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788330415.458735:0:20677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788330415.459856:0:20677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.459870:0:20677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.459878:0:20677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.459885:0:20677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.459950:0:20677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330415.459957:0:20677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.459965:0:20677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.459971:0:20677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.459991:0:20677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460239:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330415.460246:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460264:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330415.460268:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460277:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330415.460392:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330415.460399:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330415.460401:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788330415.460428:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460434:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788330415.460499:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792487168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330415.460563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330415.460631:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460639:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460652:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330415.460656:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460661:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91a800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330415.460663:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460669:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330415.460675:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330415.460680:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330415.460682:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788330415.460694:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.460701:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788330415.460745:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792487168 00000100:00100000:2.0:1788330415.460752:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792487168 00000100:00100000:2.0:1788330415.460799:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330415.460809:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:3648:x1875199792487168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330415.460821:0:19442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330415.460833:0:19442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147a400/0x8475908e9fd1fd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd1fd0 expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330415.460844:0:19442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330415.460906:0:20677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1788330415.460911:0:20677:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788330415.460921:0:20677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.460929:0:20677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.460936:0:20677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.460942:0:20677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.460954:0:20677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330415.460959:0:20677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.460966:0:20677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.460972:0:20677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.460978:0:20677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330415.460996:0:20677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788330415.460999:0:20677:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788330415.461012:0:20677:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788330415.461043:0:20677:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788330415.461047:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788330415.461050:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330415.461056:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788330415.461061:0:20677:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99edc7e22800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788330415.461066:0:20677:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99eededf6000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788330415.461070:0:20677:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99eededb1000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788330415.461081:0:20677:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99eee727c800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788330415.461087:0:20677:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff99edc5da4800 14374cd5-fe9e-406e-8acf-b98a60f93e29 192.168.202.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1788330415.461092:0:20677:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff99eededf3800 99dd523a-1cb7-4908-afb4-ee09ad740fbd 192.168.202.50@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1788330415.461096:0:20677:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff99edc67d99b8) has exports, disconnecting them 00000020:00080000:1.0:1788330415.461100:0:20677:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99edc7e22800), last request at 1788330412 00000020:00000080:1.0:1788330415.461106:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd23b2 00000100:00080000:1.0:1788330415.461120:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99edc7e21000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788330415.461195:0:20677:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc7e22800): rc 0 00000020:00000080:1.0:1788330415.461198:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc7e22800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788330415.461207:0:20677:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99eededf6000), last request at 1788330412 00000020:00000080:1.0:1788330415.461210:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2254 00000100:00080000:1.0:1788330415.461215:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99eededf0000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788330415.461220:0:20677:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eededf6000): rc 0 00000020:00000080:1.0:1788330415.461222:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eededf6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788330415.461225:0:20677:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99eededb1000), last request at 1788330331 00000020:00000080:1.0:1788330415.461233:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd219e 00000100:00080000:1.0:1788330415.461236:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99eededb1800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788330415.461242:0:20677:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eededb1000): rc 0 00000020:00000080:1.0:1788330415.461243:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eededb1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788330415.461247:0:20677:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99eee727c800), last request at 1788330331 00000020:00000080:1.0:1788330415.461261:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2143 00000100:00080000:1.0:1788330415.461264:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99eee7270800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788330415.461269:0:20677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:1.0:1788330415.461355:0:20677:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eee727c800): rc 0 00000004:00000080:1.0:1788330415.461361:0:20677:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb7bcc85c7ae0 00000100:00080000:1.0:1788330415.461378:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788330415.461381:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788330415.462117:0:20677:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788330415.462141:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788330415.462357:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788330415.462361:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788330415.462372:0:20677:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788330415.462445:0:20677:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788330415.462456:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788330415.462461:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788330415.462464:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788330415.462472:0:20677:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788330415.462539:0:20677:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788330415.462547:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788330415.462589:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99edc67d99b8) has no exports 00010000:00010000:3.0:1788330415.462935:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.462947:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.462984:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330415.462989:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.462995:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330415.463008:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463018:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330415.463024:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330415.463029:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788330415.463032:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788330415.463035:0:17092:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788330415.463059:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463065:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330415.463100:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463107:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463116:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330415.463119:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463132:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147a600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330415.463135:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463142:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330415.463165:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330415.463172:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330415.463175:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788330415.463177:0:17092:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788330415.463190:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463196:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330415.463203:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463209:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.463219:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330415.463221:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330415.463223:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330415.463239:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792487296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330415.463527:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792487808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330415.463583:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:3648:x1875199792487168:12345-0@lo:103:ldlm_bl.0 Request processed in 2773us (3017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330415.463593:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330415.463686:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792487168:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788330415.463785:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7e22800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788330415.463841:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eededf6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788330415.463861:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eededb1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788330415.463887:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7e21000 for lustre-MDT0000 00000020:00000080:0.0:1788330415.463893:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eededf0000 for lustre-MDT0000 00000020:00000080:0.0:1788330415.463897:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eededb1800 for lustre-MDT0000 00000100:00100000:3.0:1788330415.464464:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330415.464514:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330415.464537:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792487936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330415.464569:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330415.464596:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792487424:0@lo:39:umount.0 00000100:00100000:3.0:1788330415.464626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330415.464647:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792487552:0@lo:9:umount.0 00000100:00100000:3.0:1788330415.464670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330415.464688:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792487680:0@lo:9:umount.0 00000100:00100000:3.0:1788330415.464707:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330415.464738:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792487552 00000100:00100000:3.0:1788330415.464745:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792487552 00000100:00100000:3.0:1788330415.464790:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792487680 00000100:00100000:3.0:1788330415.464794:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792487680 00000100:00100000:3.0:1788330415.464816:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330415.464825:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875199792487552:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788330415.464852:0:18610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2293 00000100:00080000:3.0:1788330415.464861:0:18610:0:(import.c:65:import_set_state_nolock()) ffff99eec91d6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330415.464907:0:18610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788330415.465121:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3645:x1875199792487552:12345-0@lo:9:umount.0 Request processed in 296us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330415.465129:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330415.465142:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330415.465173:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875199792487680:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788330415.465186:0:18610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd23f1 00000100:00080000:3.0:1788330415.465193:0:18610:0:(import.c:65:import_set_state_nolock()) ffff99edc64ac000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330415.465216:0:18610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788330415.465422:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3645:x1875199792487680:12345-0@lo:9:umount.0 Request processed in 273us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330415.465441:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788330415.465463:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330415.465467:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788330415.465478:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330415.465502:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788330415.465515:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788330415.465518:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330415.465521:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792487552:0@lo:9:umount.0 00000100:00080000:3.0:1788330415.465530:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788330415.465538:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788330415.465539:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330415.465542:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792487680:0@lo:9:umount.0 00010000:00010000:3.0:1788330415.465560:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330415.465570:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792487296 00000100:00100000:3.0:1788330415.465574:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792487296 00000100:00100000:3.0:1788330415.465604:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792487936 00000100:00100000:3.0:1788330415.465606:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792487936 00000100:00100000:3.0:1788330415.465624:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330415.465631:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:3649:x1875199792487296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330415.465640:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330415.465659:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7eee00/0x8475908e9fd23ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd23e3 expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.465674:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330415.465704:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:3649:x1875199792487296:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330415.465710:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330415.465721:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330415.465733:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd762850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3647:x1875199792487936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330415.465742:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330415.465752:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9039a00/0x8475908e9fd1fc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd1fc2 expref: 21 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330415.465760:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330415.465787:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd762850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:3647:x1875199792487936:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330415.465794:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330415.465841:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792487296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330415.465863:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792487936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330415.465877:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330415.466229:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792487424 00000100:00100000:0.0:1788330415.466234:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792487424 00000100:00100000:0.0:1788330415.466280:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788330415.466297:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875199792487424:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788330415.466318:0:19787:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd21c8 00000100:00080000:0.0:1788330415.466325:0:19787:0:(import.c:65:import_set_state_nolock()) ffff99eededf5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330415.466342:0:19787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788330415.466446:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3645:x1875199792487424:12345-0@lo:39:umount.0 Request processed in 159us (1819us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788330415.466454:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1788330415.466824:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330415.466848:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788330415.466855:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792487424:0@lo:39:umount.0 00000100:00100000:1.0:1788330415.467425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330415.467536:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792487808 00000100:00100000:2.0:1788330415.467542:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792487808 00000100:00100000:2.0:1788330415.467586:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330415.467595:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:3646:x1875199792487808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330415.467607:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330415.467622:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79a00/0x8475908e9fd258e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd2587 expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330415.467636:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330415.467676:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:3646:x1875199792487808:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330415.467684:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330415.467777:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792487808:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788330415.474618:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99edc67d99b8) has no exports 00000020:00000080:2.0:1788330415.522671:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd201d 00000020:00000080:2.0:1788330415.522692:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eef58db800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788330415.522759:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788330415.522852:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330415.522863:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788330415.522868:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99eef6df0000) has no exports 00000020:00000080:0.0:1788330415.523600:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef58db800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788330415.523724:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2016 00000020:00000080:3.0:1788330415.523732:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eee727d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788330415.523793:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330415.523802:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788330415.523805:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eee727a800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788330415.523808:0:20677:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee727a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788330415.523815:0:20677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788330415.523991:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee727d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788330415.709288:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330416.731454:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788330417.061260:0:19426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788330417.061272:0:19426:0:(genops.c:885:class_export_put()) final put ffff99edc64ae000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788330417.061303:0:17837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788330417.061303:0:19426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000020:00000080:0.0:1788330417.061309:0:19426:0:(genops.c:885:class_export_put()) final put ffff99eeded78000/99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000001:00080000:1.0:1788330417.061319:0:17837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788330417.061324:0:17837:0:(genops.c:885:class_export_put()) final put ffff99eeffd06800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788330417.061333:0:17837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 14374cd5-fe9e-406e-8acf-b98a60f93e29 00000001:00080000:1.0:1788330417.061340:0:17837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788330417.061342:0:17837:0:(genops.c:885:class_export_put()) final put ffff99eeded7b000/14374cd5-fe9e-406e-8acf-b98a60f93e29 00000001:00100000:1.0:1788330417.061348:0:17837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000001:00080000:1.0:1788330417.061353:0:17837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788330417.061355:0:17837:0:(genops.c:885:class_export_put()) final put ffff99edc5f75800/99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000020:00000080:2.0:1788330417.061415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc64ae000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788330417.061477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eeded78000/99dd523a-1cb7-4908-afb4-ee09ad740fbd for lustre-OST0001 00000020:00000080:2.0:1788330417.061497:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eeffd06800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788330417.061523:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eeded7b000/14374cd5-fe9e-406e-8acf-b98a60f93e29 for lustre-MDT0001 00000020:00000080:2.0:1788330417.061547:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5f75800/99dd523a-1cb7-4908-afb4-ee09ad740fbd for lustre-MDT0001 00000020:00000080:2.0:1788330417.061569:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc64ac000 for lustre-OST0001 00000020:00000080:2.0:1788330417.061575:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eeded7f000 for lustre-OST0001 00000020:00000080:2.0:1788330417.061579:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eededf5800 for lustre-MDT0001 00000020:00000080:2.0:1788330417.061583:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eeded7e800 for lustre-MDT0001 00000020:00000080:2.0:1788330417.061586:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eeded7d000 for lustre-MDT0001 00000001:00100000:3.0:1788330417.064608:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788330417.064761:0:17083:0:(genops.c:885:class_export_put()) final put ffff99eee727c800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788330417.064844:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14374cd5-fe9e-406e-8acf-b98a60f93e29 00000001:00080000:3.0:1788330417.064854:0:17083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1788330417.064857:0:17083:0:(genops.c:885:class_export_put()) final put ffff99edc5da4800/14374cd5-fe9e-406e-8acf-b98a60f93e29 00000020:00000080:1.0:1788330417.066578:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee727c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788330417.066821:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eee7270800 for lustre-MDT0000 00000001:00100000:3.0:1788330417.069635:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000001:00080000:3.0:1788330417.069652:0:17083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1788330417.069662:0:17083:0:(genops.c:885:class_export_put()) final put ffff99eededf3800/99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000020:00000080:2.0:1788330417.073881:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5da4800/14374cd5-fe9e-406e-8acf-b98a60f93e29 for lustre-MDT0000 00000020:00000080:2.0:1788330417.075760:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5da0000 for lustre-MDT0000 00000020:00000080:2.0:1788330417.076981:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eededf3800/99dd523a-1cb7-4908-afb4-ee09ad740fbd for lustre-MDT0000 00000020:00000080:2.0:1788330417.077046:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5f72800 for lustre-MDT0000 00000100:00100000:3.0:1788330417.563556:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330417.563581:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792488064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330417.563725:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330417.563795:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792488064 00000100:00100000:3.0:1788330417.563804:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792488064 00000100:00100000:3.0:1788330417.563865:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788330417.563876:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792488064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330417.563909:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788330417.563956:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792488064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330417.563963:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788330417.563985:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330417.564022:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792488064:0@lo:13:osp-pre-1-1.0 00000020:01000000:2.0:1788330417.564114:0:20677:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eef41264e0 - data ffff99eedf94bd80/ffff99edc5faa000 00000020:01000000:2.0:1788330417.564291:0:20677:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99edc7e96120 - data ffff99edc595b438/ffff99eec8be2000 00000100:00100000:3.0:1788330417.565719:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792488192:0@lo:400:kworker.0 00000100:00100000:2.0:1788330417.565770:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792488448:0@lo:400:kworker.0 00000100:00100000:3.0:1788330417.565792:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330417.565814:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330417.565845:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792488960:0@lo:400:kworker.0 00000100:00100000:3.0:1788330417.565854:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792488704:0@lo:400:kworker.0 00000100:00100000:2.0:1788330417.565875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330417.565966:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792488192 00000100:00100000:0.0:1788330417.565974:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792488192 00000100:00100000:0.0:1788330417.566020:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788330417.566030:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc661c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:3649:x1875199792488192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330417.566085:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792488448 00000100:00100000:3.0:1788330417.566090:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792488448 00000100:00100000:3.0:1788330417.566141:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788330417.566183:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792488448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330417.568553:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792488320:0@lo:400:kworker.0 00000100:00100000:0.0:1788330417.568983:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc661c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:3649:x1875199792488192:12345-0@lo:400:kworker.0 Request processed in 2951us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330417.568996:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788330417.569207:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330417.569223:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792488576:0@lo:400:kworker.0 00000100:00100000:0.0:1788330417.569267:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330417.569297:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792489088:0@lo:400:kworker.0 00000100:00100000:0.0:1788330417.569320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330417.569366:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792488960 00000100:00100000:0.0:1788330417.569375:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792488960 00000100:00100000:0.0:1788330417.569638:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792488576 00000100:00100000:0.0:1788330417.569643:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792488576 00000100:00100000:0.0:1788330417.569657:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792489088 00000100:00100000:0.0:1788330417.569660:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792489088 00000100:00100000:0.0:1788330417.569685:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788330417.569694:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792489088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330417.569763:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792489088:12345-0@lo:400:kworker.0 Request processed in 70us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330417.569771:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788330417.569785:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788330417.569789:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875199792488960:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788330417.569796:0:17105:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788330417.569820:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875199792488960:12345-0@lo:400:kworker.0 Request processed in 30us (3946us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788330417.569827:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788330417.569838:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788330417.569841:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875199792488576:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788330417.569845:0:17105:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788330417.569864:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875199792488576:12345-0@lo:400:kworker.0 Request processed in 21us (597us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788330417.569870:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788330417.569886:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330417.569911:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788330417.569915:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99eededb3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788330417.569919:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788330417.575638:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792488448:12345-0@lo:400:kworker.0 Request processed in 9440us (9808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330417.575657:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788330417.575733:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330417.575806:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792488192:0@lo:400:kworker.0 00000100:00100000:3.0:1788330417.575847:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792488704 00000100:00100000:3.0:1788330417.575856:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792488704 00000100:00100000:3.0:1788330417.575894:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788330417.575901:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875199792488704:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788330417.575909:0:17105:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788330417.575955:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875199792488704:12345-0@lo:400:kworker.0 Request processed in 54us (222us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788330417.575961:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788330417.575988:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788330417.575992:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99edc6580800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788330417.575996:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788330417.576002:0:3649:0:(import.c:65:import_set_state_nolock()) ffff99edc6580800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330417.576006:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 556 00000100:00080000:3.0:1788330417.576012:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99edc6580800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330417.576044:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eec995fb80 x1875199792489216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330417.576064:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792488704:0@lo:400:kworker.0 00000100:00100000:3.0:1788330417.576083:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792489216:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788330417.576762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330417.576808:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792489216 00000100:00100000:3.0:1788330417.576813:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792489216 00000100:00100000:3.0:1788330417.576837:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788330417.576844:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792489216:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788330417.576862:0:17105:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788330417.581933:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99eededb3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330417.581945:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 535 00000100:00080000:0.0:1788330417.581955:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99eededb3800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330417.582005:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffc9bb80 x1875199792489344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330417.582055:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792488576:0@lo:400:kworker.0 00010000:00080000:0.0:1788330417.582124:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fce00 x1875199792489088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330417.582137:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792489088:0@lo:400:kworker.0 00000100:00080000:2.0:1788330417.583638:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788330417.583645:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99eedef8b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788330417.583660:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788330417.583681:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99eedef8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330417.583685:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 575 00000100:00080000:2.0:1788330417.583691:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99eedef8b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330417.583719:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fe680 x1875199792489472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330417.583735:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792488960:0@lo:400:kworker.0 00000100:00100000:0.0:1788330417.584326:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792489344:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788330417.584511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330417.584550:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792489472:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788330417.584575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330417.584611:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792489344 00000100:00100000:0.0:1788330417.584619:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792489344 00000100:00100000:0.0:1788330417.584652:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792489472 00000100:00100000:0.0:1788330417.584654:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792489472 00000100:00100000:0.0:1788330417.584666:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788330417.584673:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875199792489344:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788330417.584693:0:18635:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788330417.584733:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875199792489344:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 59us (222us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330417.584740:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788330417.584756:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330417.584761:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875199792489472:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788330417.584768:0:18635:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788330417.584793:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875199792489472:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31us (217us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330417.584799:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788330417.584829:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eededb3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330417.584835:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788330417.584838:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792489344:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788330417.584863:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eedef8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330417.584866:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788330417.584869:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792489472:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788330417.585959:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792488448:0@lo:400:kworker.0 00000100:00100000:1.0:1788330417.586249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330417.586301:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792488832:0@lo:400:kworker.0 00000100:00100000:1.0:1788330417.586343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330417.586488:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792488832 00000100:00100000:2.0:1788330417.586495:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792488832 00000100:00100000:2.0:1788330417.586551:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788330417.586560:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792488832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330417.586610:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792488832:12345-0@lo:400:kworker.0 Request processed in 51us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330417.586616:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788330417.588668:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792488320 00000100:00100000:0.0:1788330417.588685:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792488320 00000100:00100000:0.0:1788330417.588747:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788330417.588756:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875199792488320:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788330417.588768:0:17108:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788330417.588856:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875199792488320:12345-0@lo:400:kworker.0 Request processed in 99us (2607us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788330417.588864:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788330417.589181:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330417.589220:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788330417.589225:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99eef58df000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788330417.589240:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788330417.589247:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99eef58df000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330417.589252:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 535 00000100:00080000:1.0:1788330417.589259:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99eef58df000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330417.589295:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8452680 x1875199792489600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330417.589351:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792488320:0@lo:400:kworker.0 00010000:00080000:1.0:1788330417.589368:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc000 x1875199792488832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330417.589379:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792488832:0@lo:400:kworker.0 00000100:00100000:0.0:1788330417.589508:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792489600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788330417.589554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330417.589670:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792489600 00000100:00100000:2.0:1788330417.589676:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792489600 00000100:00100000:2.0:1788330417.589707:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788330417.589715:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792489600:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788330417.589732:0:17109:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788330417.589787:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792489600:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 72us (232us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788330417.589794:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788330417.589968:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eef58df000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330417.589973:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788330417.589976:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792489600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788330417.608612:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792489216:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31760us (31846us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788330417.608628:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788330417.608730:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc6580800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330417.608738:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788330417.608743:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792489216:0@lo:38:ptlrpcd_00_03.0 00000001:00000004:3.0:1788330417.610403:0:20677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1788330417.711873:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330417.711887:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788330417.711910:0:20677:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99eef6d42a00 x1875199792487424/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788330425 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330417.711970:0:20677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788330417.716757:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788330417.716768:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788330417.716824:0:20677:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330417.716828:0:20677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788330417.717109:0:17127:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788330417.717115:0:17127:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788330417.717127:0:17127:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788330417.719125:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788330417.719136:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1788330417.719343:0:20677:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330417.719347:0:20677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788330417.722473:0:17129:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788330417.722484:0:17129:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788330417.722497:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788330417.724707:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd1fe5 00000020:00000080:2.0:1788330417.724726:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eef6de7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788330417.726859:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd1ffa 00000020:00000080:2.0:1788330417.726879:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc759f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330417.726939:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6de7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788330417.727033:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788330417.727041:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330417.727052:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788330417.727058:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff99edc67db370) has no exports 00000020:00000080:1.0:1788330417.727699:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc759f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788330417.727735:0:20677:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788330417.727826:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd205c 00000020:00000080:3.0:1788330417.727835:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eef58dc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788330417.727877:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788330417.727884:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330417.727890:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788330417.727893:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff99eec8bb0000) has no exports 00000020:00000080:3.0:1788330417.727901:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2055 00000020:00000080:3.0:1788330417.727905:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eee7218000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788330417.727922:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef58dc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788330417.728706:0:20677:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788330417.728714:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788330417.728720:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788330417.728731:0:20677:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330417.728734:0:20677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788330417.728902:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7218000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788330417.729005:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330417.729014:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788330417.729022:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2047 00000020:00000080:3.0:1788330417.729029:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eee721d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330417.729048:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eee721f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788330417.729056:0:13408:0:(genops.c:885:class_export_put()) final put ffff99eee721e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330417.729058:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee721e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788330417.729064:0:13408:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788330417.729533:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788330417.729636:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330417.729645:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788330417.729661:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff99eef6df19b8) has no exports 00000020:00000080:3.0:1788330417.729668:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2040 00000020:00000080:3.0:1788330417.729672:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eee7210000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788330417.729809:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee721d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1788330417.730525:0:20677:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788330417.730531:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788330417.730547:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788330417.730555:0:20677:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330417.730557:0:20677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788330417.730763:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7210000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788330417.730855:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330417.730864:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788330417.730883:0:20677:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788330417.730889:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2032 00000020:00000080:3.0:1788330417.730896:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eee7215000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330417.730916:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eee7217000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788330417.730922:0:13408:0:(genops.c:885:class_export_put()) final put ffff99eee7216000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330417.730925:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7216000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788330417.730931:0:13408:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788330417.731073:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788330417.731079:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330417.731084:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788330417.731089:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff99eefd333370) has no exports 00000020:00000080:3.0:1788330417.731096:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd202b 00000020:00000080:3.0:1788330417.731100:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc759b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788330417.731115:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7215000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788330417.732622:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc759b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788330417.739251:0:20677:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788330417.739384:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330417.739390:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788330417.739402:0:20677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330417.739476:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330417.739493:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330417.739534:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330417.739538:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330417.739546:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eef6de5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788330417.739552:0:20677:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6de5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788330417.739568:0:20677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330417.739689:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2001 00000020:00000080:2.0:1788330417.739708:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc759c000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788330417.739713:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788330417.739717:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330417.739722:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788330417.739727:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff99edc67dcd28) has no exports 00000020:00000080:2.0:1788330417.739748:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330417.739751:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788330417.739756:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2008 00000020:00000080:2.0:1788330417.739759:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc759e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788330417.739769:0:20677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7d05800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788330417.739773:0:20677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7d05800 3 00000020:01000004:2.0:1788330417.739777:0:20677:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99edc7d05800 from lustre-MDT0000 00000020:00000080:2.0:1788330417.739800:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330417.739804:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788330417.739809:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eef6de1800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788330417.739812:0:20677:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6de1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788330417.739820:0:20677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788330417.739858:0:20677:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788330417.739862:0:20677:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788330417.739866:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788330417.739869:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330417.739872:0:20677:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788330417.739880:0:20677:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff99edc67eb000 6efb806c-ba9f-4d20-bba3-c0a9c1d82585 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788330417.739886:0:20677:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff99eef6df3370) has exports, disconnecting them 00000020:00080000:2.0:1788330417.739894:0:20677:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99edc67eb000), last request at 1788330315 00000020:00000080:2.0:1788330417.739914:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd1fad 00000020:00010000:2.0:1788330417.739919:0:20677:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99edc67eb000: total 2 00000100:00080000:2.0:1788330417.739926:0:20677:0:(import.c:65:import_set_state_nolock()) ffff99edc67ea800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788330417.739951:0:20677:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc67eb000): rc 0 00000020:00080000:2.0:1788330417.739956:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff99eef6df3370) has no exports 00000020:00000080:1.0:1788330417.740456:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc759f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788330417.740468:0:13408:0:(genops.c:885:class_export_put()) final put ffff99edc7598800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330417.740471:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7598800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788330417.740479:0:13408:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788330417.740580:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc759c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788330417.740585:0:13408:0:(genops.c:885:class_export_put()) final put ffff99edc759b800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788330417.740587:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc759b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788330417.740592:0:13408:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788330417.740620:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc759e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788330417.740662:0:17091:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99edc67eb000: total 0 00010000:00010000:3.0:1788330417.740668:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330417.740708:0:17091:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99edc67eb000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788330417.740748:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd2580 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd2579 expref: 14 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740769:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1327e00/0x8475908e9fd2373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd236c expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740782:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9038600/0x8475908e9fd220e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd2207 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740793:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1326800/0x8475908e9fd239d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd2396 expref: 11 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740818:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91ae00/0x8475908e9fd23dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd23d5 expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740836:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1326600/0x8475908e9fd20cc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd20c5 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740847:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ee000/0x8475908e9fd2238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd2231 expref: 8 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740856:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2564 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd255d expref: 7 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740865:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1327600/0x8475908e9fd2189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd2182 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740875:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1327a00/0x8475908e9fd20da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd20d3 expref: 5 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740885:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7eec00/0x8475908e9fd2572 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd256b expref: 4 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740898:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1327c00/0x8475908e9fd20e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd20e1 expref: 3 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740908:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1326400/0x8475908e9fd1fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd1fb4 expref: 2 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330417.740919:0:17091:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99edc67eb000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788330417.740935:0:17091:0:(genops.c:885:class_export_put()) final put ffff99edc67eb000/6efb806c-ba9f-4d20-bba3-c0a9c1d82585 00010000:00010000:3.0:1788330417.740950:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330417.740957:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330417.740959:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330417.741087:0:17098:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99eefd34c000:17098] 2 exiting: rc = 0 00000020:00000080:1.0:1788330417.741351:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc67eb000/6efb806c-ba9f-4d20-bba3-c0a9c1d82585 for MGS 00000020:00000080:1.0:1788330417.741385:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc67ea800 for MGS 00000100:00100000:1.0:1788330417.748092:0:17095:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99eec92e0200:17095] 0 exiting: rc = 1 00000100:00100000:1.0:1788330417.749610:0:17097:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99eefd34c400:17097] 1 exiting: rc = 0 00000100:00100000:2.0:1788330417.749841:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749865:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749872:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749879:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749887:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749893:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749900:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749907:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749915:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749921:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749928:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749934:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749939:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749945:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749951:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749957:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749965:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749972:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749978:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749985:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749991:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.749998:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750007:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750013:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750019:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750026:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750032:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750038:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750045:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750052:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750059:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750066:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750071:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750078:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750084:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750090:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750106:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750113:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750120:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750125:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750131:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750137:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750142:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750366:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750379:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750386:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750393:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750399:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750405:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750412:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750419:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750426:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750433:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750439:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750446:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750451:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750457:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750462:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750469:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750475:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750482:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750489:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750495:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330417.750501:0:20677:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788330417.760367:0:20677:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eec53e3cc0 - data ffff99eecd2c0000/ffff99edc87cd400 00000020:01000000:2.0:1788330417.760570:0:20677:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99edc72674e0 - data ffff99eedf9b80d8/ffff99eec8d1a800 00000020:00000080:2.0:1788330417.761120:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd1f91 00000020:00000080:2.0:1788330417.761133:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc7eab800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788330417.761179:0:20677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7d05800 from MGS, refs=2 00000020:01000004:2.0:1788330417.761184:0:20677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7d05800 2 00000020:01000004:2.0:1788330417.761201:0:20677:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99edc7d05800 from MGS 00000020:00000080:2.0:1788330417.761239:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330417.761250:0:20677:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788330417.761253:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc7eaa000/MGS 00000020:00000080:2.0:1788330417.761257:0:20677:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7eaa000/MGS for MGS 00000020:01000000:2.0:1788330417.761267:0:20677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788330417.761356:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788330417.761362:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330417.761370:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788330417.761379:0:20677:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99eee7271800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788330417.761386:0:20677:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff99eeffc4cd28) has exports, disconnecting them 00000020:00080000:2.0:1788330417.761393:0:20677:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99eee7271800), last request at 1788330315 00000020:00000080:2.0:1788330417.761398:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2094 00000020:00080000:2.0:1788330417.761409:0:20677:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eee7271800): rc 0 00000020:00000080:2.0:1788330417.761413:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eee7271800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788330417.763011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7eab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788330417.763033:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7271800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788330417.764462:0:20677:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788330417.764474:0:20677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788330417.764481:0:20677:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788330417.764491:0:20677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788330417.764529:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eee7275800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788330417.764804:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330417.764817:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788330417.764825:0:20677:0:(genops.c:885:class_export_put()) final put ffff99eee7276800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788330417.764830:0:20677:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7276800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788330417.764842:0:20677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788330417.764972:0:20677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7d05800 1 00000020:00000080:1.0:1788330417.764994:0:20677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd1f83 00000020:00000080:1.0:1788330417.765004:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc7eab000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788330417.765015:0:20677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788330417.765024:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7eab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788330417.765036:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330417.765041:0:20677:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788330417.765047:0:20677:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff99eef5833370) has no exports 00010000:00010000:3.0:1788330418.008300:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788330418.022791:0:20677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330418.022807:0:20677:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788330418.022814:0:20677:0:(genops.c:885:class_export_put()) final put ffff99edc7d01000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788330418.022819:0:20677:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7d01000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788330418.022826:0:20677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788330418.022952:0:20677:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99edc7d07000 00000020:02000400:2.0:1788330418.023031:0:20677:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788330418.075398:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330418.075425:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792489728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330418.075508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330418.075639:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792489728 00000100:00100000:3.0:1788330418.075649:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792489728 00000100:00100000:3.0:1788330418.075714:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330418.075725:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792489728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330418.075755:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788330418.075810:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792489728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330418.075818:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330418.075947:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792489728:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788330419.036439:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330420.063203:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330421.085796:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788330421.151510:0:18607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788330421.151522:0:18607:0:(genops.c:885:class_export_put()) final put ffff99eec91d2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330421.151667:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec91d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788330421.151738:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eec91d6800 for lustre-OST0000 00000020:01000004:1.0:1788330421.948976:0:20878:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788330421.954948:0:20878:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788330421.955009:0:20878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.955025:0:20878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.955052:0:20878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.955059:0:20878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.955090:0:20878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788330421.955097:0:20878:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788330421.955124:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330421.955129:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788330421.955136:0:20878:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788330421.955142:0:20878:0:(import.c:65:import_set_state_nolock()) ffff99eededb3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788330421.955147:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330421.955166:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788330421.955169:0:20878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788330421.955849:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330421.955858:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330421.955866:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326e00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330421.955869:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330421.955877:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330421.955884:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330421.955890:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330421.955892:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788330421.955895:0:17092:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788330421.955934:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330421.955946:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330421.955976:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330421.955983:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330421.955996:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330421.955998:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330421.956000:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330421.956018:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792489856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330421.956086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330421.956807:0:20878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956819:0:20878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956826:0:20878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956834:0:20878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956859:0:20878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330421.956869:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330421.956873:0:20878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.956875:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956881:0:20878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.956882:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330421.956885:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956887:0:20878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.956893:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956894:0:20878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330421.956900:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330421.956905:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330421.956906:0:20878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788330421.956908:0:17091:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788330421.956911:0:20878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956917:0:20878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956922:0:20878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.956927:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956929:0:20878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.956933:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330421.956939:0:20878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788330421.956944:0:20878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.956950:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956951:0:20878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.956957:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956961:0:20878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956967:0:20878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.956969:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330421.956972:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330421.956975:0:20878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788330421.956977:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039e00 already unused, calling callback (ffffffffc14efc20) 10000000:01000000:0.0:1788330421.956978:0:20878:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:00010000:1.0:1788330421.956980:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330421.956982:0:20878:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1788330421.956986:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330421.956991:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330421.956995:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788330421.956997:0:17091:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788330421.956999:0:17091:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:01000004:0.0:1788330421.957005:0:20878:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00010000:00010000:1.0:1788330421.957009:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788330421.957010:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788330421.957013:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788330421.957015:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1788330421.957018:0:20878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788330421.957024:0:20878:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99edc7e23000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788330421.957029:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788330421.957030:0:20878:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99edc7f1b000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788330421.957036:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788330421.957036:0:20878:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff99eeffc499b8) has exports, disconnecting them 00000020:00080000:0.0:1788330421.957040:0:20878:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99edc7e23000), last request at 1788330417 00000020:00000080:0.0:1788330421.957046:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd23c7 00010000:00010000:1.0:1788330421.957058:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00080000:0.0:1788330421.957061:0:20878:0:(import.c:65:import_set_state_nolock()) ffff99edc7e26800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788330421.957062:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.957067:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330421.957070:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.957076:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330421.957081:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330421.957086:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788330421.957088:0:17091:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788330421.957090:0:17091:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788330421.957104:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788330421.957104:0:20878:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc7e23000): rc 0 00000020:00000080:0.0:1788330421.957106:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc7e23000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:1.0:1788330421.957109:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330421.957115:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788330421.957116:0:20878:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99edc7f1b000), last request at 1788330417 00000020:00000080:0.0:1788330421.957119:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2262 00010000:00010000:1.0:1788330421.957122:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330421.957124:0:20878:0:(import.c:65:import_set_state_nolock()) ffff99edc7f1e800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788330421.957130:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:0.0:1788330421.957130:0:20878:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc7f1b000): rc 0 00000020:00000080:0.0:1788330421.957132:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc7f1b000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:1.0:1788330421.957134:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1788330421.957139:0:20878:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb7bcc1d8fae0 00010000:00010000:1.0:1788330421.957145:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7efe00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330421.957147:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.957172:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330421.957177:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330421.957178:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:1.0:1788330421.957182:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:0.0:1788330421.957182:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 10000000:01000000:1.0:1788330421.957184:0:17091:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788330421.957186:0:17091:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788330421.957210:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.957217:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330421.957222:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.957229:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330421.957239:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330421.957241:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330421.957242:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330421.957254:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792490112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330421.957297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330421.957345:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330421.957358:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefcd77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792490240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330421.957381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788330421.957409:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7e23000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788330421.957466:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7f1b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788330421.957490:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7e26800 for lustre-MDT0001 00000020:00000080:1.0:1788330421.957493:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7f1e800 for lustre-MDT0001 00000100:00100000:1.0:1788330421.957512:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792489856 00000100:00100000:1.0:1788330421.957519:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792489856 00000100:00100000:1.0:1788330421.957557:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792490112 00000100:00100000:1.0:1788330421.957559:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792490112 00000100:00100000:1.0:1788330421.957571:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792490240 00000100:00100000:1.0:1788330421.957573:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792490240 00000100:00100000:1.0:1788330421.957585:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330421.957592:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3646:x1875199792489856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788330421.957598:0:20133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330421 with bad export cookie 596543370470170541 00000100:00080000:0.0:1788330421.959946:0:20878:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788330421.959959:0:20878:0:(import.c:65:import_set_state_nolock()) ffff99eef58df000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788330421.960145:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788330421.960866:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330421.960876:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875199792490112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788330421.960884:0:19442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330421 with bad export cookie 596543370470170541 00000100:00100000:2.0:1788330421.960961:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792489984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330421.960974:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875199792490112:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (3677us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788330421.960981:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788330421.961001:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330421.961005:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330421.961010:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875199792490240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788330421.961014:0:19442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330421 with bad export cookie 596543370470170541 00000100:00100000:2.0:1788330421.961025:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330421.961039:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875199792490240:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (3657us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788330421.961043:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330421.961048:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792490368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330421.961054:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792489984 00000100:00100000:3.0:1788330421.961060:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792489984 00000100:00100000:2.0:1788330421.961067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330421.961086:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792490368 00000100:00100000:3.0:1788330421.961089:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792490368 00000100:00100000:2.0:1788330421.961090:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788330421.961094:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875199792489984:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330421.961099:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00020000:2.0:1788330421.961099:0:17088:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330421 with bad export cookie 596543370470170541 00000100:00100000:3.0:1788330421.961102:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1875199792490368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788330421.961106:0:19442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330421 with bad export cookie 596543370470170541 00000100:00100000:0.0:1788330421.961248:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788330421.961261:0:20878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788330421.961329:0:20878:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788330421.961422:0:20878:0:(import.c:65:import_set_state_nolock()) ffff99eec289b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788330421.961442:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788330421.961446:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788330421.961454:0:20878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788330421.961522:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792490496:0@lo:9:umount.0 00000100:00100000:0.0:1788330421.961556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330421.961591:0:20878:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788330421.961711:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1875199792490368:12345-0@lo:103:ldlm_bl.0 Request processed in 605us (641us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788330421.961718:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788330421.961740:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330421.961784:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875199792489984:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (128us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788330421.961791:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788330421.961832:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788330421.961836:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788330421.961840:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788330421.961898:0:20878:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788330421.961918:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792490624:0@lo:9:umount.0 00000100:00100000:0.0:1788330421.961945:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788330421.962006:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff99eeffc499b8) has no exports 00000100:00100000:3.0:1788330421.962850:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792490496 00000100:00100000:3.0:1788330421.962859:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792490496 00000100:00100000:3.0:1788330421.963020:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792490624 00000100:00100000:3.0:1788330421.963024:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792490624 00000100:00080000:0.0:1788330421.963054:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330421.963059:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330421.963146:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788330421.963172:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875199792490496:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788330421.963211:0:18612:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd228c 00000100:00080000:3.0:1788330421.963220:0:18612:0:(import.c:65:import_set_state_nolock()) ffff99eee7271000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330421.963268:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788330421.963461:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1875199792490496:12345-0@lo:9:umount.0 Request processed in 291us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330421.963469:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788330421.963485:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788330421.963492:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875199792490624:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788330421.963502:0:18612:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd23f8 00000100:00080000:3.0:1788330421.963507:0:18612:0:(import.c:65:import_set_state_nolock()) ffff99edc64a8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330421.963527:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788330421.963596:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1875199792490624:12345-0@lo:9:umount.0 Request processed in 105us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330421.963621:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788330421.963649:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330421.963680:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788330421.963686:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788330421.963688:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330421.963692:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792490624:0@lo:9:umount.0 00000100:00080000:3.0:1788330421.963703:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eec289b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788330421.963712:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788330421.963714:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330421.963716:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792490496:0@lo:9:umount.0 00000100:00080000:3.0:1788330421.963766:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788330421.972832:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3646:x1875199792489856:12345-0@lo:103:ldlm_bl.0 Request processed in 15227us (16733us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788330421.972844:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788330421.972908:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:0.0:1788330421.976299:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330421.976310:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788330421.993478:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.150@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788330421.993484:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788330421.993495:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eec995c000 x1875199792489856/t0(0) o103->MGC192.168.202.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330437 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330421.993512:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eec977bb80 x1875199792490112/t0(0) o103->MGC192.168.202.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330437 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330421.993522:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eefcd77480 x1875199792490240/t0(0) o103->MGC192.168.202.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330437 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330421.993530:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc8452680 x1875199792489984/t0(0) o103->MGC192.168.202.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330437 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330421.993538:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc7694700 x1875199792490368/t0(0) o103->MGC192.168.202.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330437 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330421.993655:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99edc67e9000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:2.0:1788330421.994368:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788330421.994373:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788330421.994375:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788330421.994380:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330421.994387:0:3647:0:(import.c:510:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788330421.994417:0:3647:0:(import.c:624:import_select_connection()) MGC192.168.202.150@tcp: import ffff99edc67e9000 using connection 192.168.202.150@tcp/0@lo 00000100:00080000:1.0:1788330421.995500:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99edc67e9000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1788330421.995526:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792489856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330421.998322:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fd880 x1875199792490752/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330421.998389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3645:1875199792490752:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788330421.998511:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875199792490752 offset 0 length 520: 4 00000100:00100000:2.0:1788330421.998590:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792489984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330421.998601:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792490112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330421.998621:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefcd77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792490240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330421.998621:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792490368:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788330422.004056:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff99eeffc499b8) has no exports 00000020:01000000:1.0:1788330422.059003:0:20878:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eef4126ba0 - data ffff99eedf94b438/ffff99edc5fa9800 00000020:01000000:1.0:1788330422.059477:0:20878:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eedec92c60 - data ffff99eedf9ce0d8/ffff99eedee2a800 00000001:00000004:1.0:1788330422.069506:0:20878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00010000:00010000:3.0:1788330422.108850:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788330422.115940:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330422.115952:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788330422.115962:0:20878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788330422.121701:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788330422.121714:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788330422.121752:0:20878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788330422.121755:0:20878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788330422.122377:0:17845:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788330422.122383:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1788330422.122396:0:17845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788330422.122986:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788330422.122991:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788330422.123011:0:20878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788330422.123013:0:20878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788330422.123636:0:17847:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788330422.123641:0:17847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788330422.123650:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788330422.124767:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd20f6 00000020:00000080:0.0:1788330422.124780:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eef58de000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788330422.125515:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd210b 00000020:00000080:0.0:1788330422.125522:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eec9032000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788330422.126410:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef58de000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788330422.126519:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788330422.126526:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330422.126536:0:20878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788330422.126541:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99eeffc48000) has no exports 00000004:01000000:0.0:1788330422.126721:0:20878:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788330422.126729:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd215f 00000020:00000080:0.0:1788330422.126735:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc7e21800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788330422.126740:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788330422.126744:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330422.126748:0:20878:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788330422.126751:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff99eec8bb19b8) has no exports 00000020:00000080:0.0:1788330422.126756:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2158 00000020:00000080:0.0:1788330422.126758:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc7e24800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788330422.127672:0:20878:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788330422.127679:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788330422.127683:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788330422.127689:0:20878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788330422.127692:0:20878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788330422.127725:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330422.127732:0:20878:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788330422.127739:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd214a 00000020:00000080:0.0:1788330422.127756:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eedfe6f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788330422.127761:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788330422.127763:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330422.127768:0:20878:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788330422.127770:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff99eee7573370) has no exports 00000020:00000080:0.0:1788330422.127774:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd213c 00000020:00000080:0.0:1788330422.127777:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc75d4000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788330422.128177:0:20878:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788330422.128181:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788330422.128183:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788330422.128196:0:20878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788330422.128197:0:20878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788330422.128435:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330422.128442:0:20878:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788330422.128455:0:20878:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788330422.128460:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd212e 00000020:00000080:0.0:1788330422.128465:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eedfe6b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788330422.128507:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788330422.128513:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330422.128516:0:20878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788330422.128520:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff99eee7570000) has no exports 00000020:00000080:0.0:1788330422.128525:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2127 00000020:00000080:0.0:1788330422.128528:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc70e9000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788330422.130129:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec9032000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1788330422.130147:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7e21800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788330422.130173:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7e24800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788330422.130180:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7e25800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788330422.130198:0:37:0:(genops.c:885:class_export_put()) final put ffff99eedfe68000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788330422.130201:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe68000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788330422.130205:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330422.130321:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe6f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788330422.130327:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788330422.130333:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eec289b000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788330422.130338:0:37:0:(genops.c:885:class_export_put()) final put ffff99eedfe6a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788330422.130340:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe6a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788330422.130346:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330422.130371:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe6b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788330422.130378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc70e9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788330422.131261:0:20878:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788330422.131268:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330422.131272:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788330422.131279:0:20878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330422.131333:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330422.131343:0:20878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330422.131370:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330422.131373:0:20878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330422.131378:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc75d3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788330422.131382:0:20878:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788330422.131387:0:20878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330422.131525:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2112 00000020:00000080:2.0:1788330422.131534:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eec9037000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788330422.131540:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788330422.131545:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330422.131551:0:20878:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788330422.131556:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99eeffc4b370) has no exports 00000020:00000080:2.0:1788330422.131588:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330422.131592:0:20878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788330422.131597:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2119 00000020:00000080:2.0:1788330422.131600:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eec2898000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788330422.131609:0:20878:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eee721d800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788330422.131612:0:20878:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eee721d800 2 00000020:01000004:2.0:1788330422.131615:0:20878:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99eee721d800 from lustre-MDT0001 00000020:00000080:2.0:1788330422.131633:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330422.131636:0:20878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788330422.131638:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eef58db000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788330422.131640:0:20878:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef58db000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788330422.131647:0:20878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788330422.131675:0:20878:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788330422.131679:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788330422.131689:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330422.131693:0:20878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788330422.131699:0:20878:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff99eef590b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788330422.131705:0:20878:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff99eef5834d28) has exports, disconnecting them 00000020:00080000:2.0:1788330422.131709:0:20878:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff99eef590b000), last request at 1788330331 00000020:00000080:2.0:1788330422.131713:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2197 00000020:00080000:2.0:1788330422.131728:0:20878:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eef590b000): rc 0 00000020:00000080:2.0:1788330422.131731:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eef590b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788330422.132974:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eef58df000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788330422.132988:0:37:0:(genops.c:885:class_export_put()) final put ffff99eec289e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788330422.132991:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec289e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788330422.132999:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788330422.133175:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec9037000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788330422.133181:0:37:0:(genops.c:885:class_export_put()) final put ffff99eee7214000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788330422.133183:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7214000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788330422.133198:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788330422.133325:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec2898000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788330422.133331:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef590b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788330422.160665:0:20878:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788330422.160677:0:20878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330422.160683:0:20878:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788330422.160691:0:20878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330422.161044:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330422.161055:0:20878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788330422.161063:0:20878:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eee721d800 1 00000020:00000080:2.0:1788330422.161070:0:20878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd20be 00000020:00000080:2.0:1788330422.161079:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc70ef800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788330422.161299:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eededb3800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788330422.161307:0:37:0:(genops.c:885:class_export_put()) final put ffff99edc70ed800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788330422.161311:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc70ed800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788330422.161322:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:2.0:1788330422.161609:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788330422.161614:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330422.161620:0:20878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788330422.161624:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff99eec8bb3370) has no exports 00000020:00000080:3.0:1788330422.163079:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc70ef800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788330422.230680:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330422.230701:0:20878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788330422.230710:0:20878:0:(genops.c:885:class_export_put()) final put ffff99eec508d000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788330422.230716:0:20878:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec508d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788330422.230730:0:20878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788330422.230873:0:20878:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99eec5088800 00000020:01000000:3.0:1788330422.230896:0:20878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788330422.230900:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330422.230906:0:20878:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788330422.230911:0:20878:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff99eef6df4d28) has no exports 00000100:00100000:1.0:1788330422.231325:0:18635:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99edc6488e00:18635] 3 exiting: rc = 0 00000100:00100000:3.0:1788330422.231707:0:17105:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff99edc7337600:17105] 2 exiting: rc = 0 00000100:00100000:0.0:1788330422.231937:0:17103:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff99edc7337400:17103] 0 exiting: rc = 1 00000100:00100000:2.0:1788330422.234135:0:17104:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff99edc7336600:17104] 1 exiting: rc = 0 00000100:00100000:3.0:1788330422.234711:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234720:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234726:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234732:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234737:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234743:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234749:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234754:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234760:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234766:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234772:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234777:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234783:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234788:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234796:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234802:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234821:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234827:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234834:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234839:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234845:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234852:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234859:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234865:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234871:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234878:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234885:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234891:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234897:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234902:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234907:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234913:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234919:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234925:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234930:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234936:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234944:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234950:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234956:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234962:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234968:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234973:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234979:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234985:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234990:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.234996:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235001:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235006:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235012:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235017:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235023:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235034:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235040:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235046:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235055:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235060:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235066:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235074:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235080:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235086:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235092:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235097:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235103:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.235109:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239127:0:17106:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99edc7689c00:17106] 0 exiting: rc = 1 00000100:00100000:1.0:1788330422.239276:0:17107:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99edc7689200:17107] 1 exiting: rc = 0 00000100:00100000:3.0:1788330422.239589:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239598:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239605:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239610:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239616:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239621:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239627:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239632:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239638:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239642:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239648:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239654:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239659:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239664:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239670:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239676:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239681:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239686:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239691:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239696:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239701:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239720:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239728:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239734:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239740:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239746:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239751:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239755:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239760:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239765:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239771:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239776:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239781:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239787:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239792:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239797:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239803:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239807:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239812:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239817:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239823:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239828:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239834:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239839:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239845:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239850:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239856:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239861:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239867:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239872:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239877:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239882:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239887:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239893:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239898:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239903:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239917:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239922:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239928:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239935:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239940:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239945:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239950:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.239955:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.240690:0:19787:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff99edc5fac200:19787] 2 exiting: rc = 0 00000100:00100000:3.0:1788330422.242554:0:17109:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99eefe82dc00:17109] 1 exiting: rc = 0 00000100:00100000:0.0:1788330422.243602:0:17108:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99eefe82d800:17108] 0 exiting: rc = 1 00000100:00100000:1.0:1788330422.245525:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245535:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245541:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245546:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245552:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245558:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245565:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245574:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245581:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245589:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245596:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245626:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245635:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245643:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245649:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245655:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245664:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245672:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245680:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245688:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245694:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245700:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245707:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245730:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245740:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245747:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245756:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245768:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245777:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245785:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245792:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245800:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245806:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245812:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245837:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245859:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245878:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245886:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245894:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245902:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245908:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245915:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245920:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245927:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245934:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245940:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245946:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245967:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245976:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245983:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245990:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.245997:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246006:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246013:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246019:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246026:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246032:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246038:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246045:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246067:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246075:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246081:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246087:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330422.246094:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330422.266861:0:17110:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99eefe82d400:17110] 0 exiting: rc = 1 00000100:00100000:0.0:1788330422.267076:0:17111:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99edc5f40a00:17111] 1 exiting: rc = 0 00000100:00100000:0.0:1788330422.267141:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267148:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267171:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267176:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267182:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267198:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267218:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267233:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267240:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267246:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267251:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267257:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267263:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267268:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267273:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267279:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267284:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267289:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267295:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267301:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267306:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267312:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267317:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267322:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267327:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267332:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267338:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267343:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267349:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267354:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267359:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267364:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267369:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267374:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267379:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267385:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267390:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267395:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267401:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267406:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267411:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267427:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267432:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267437:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267442:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267447:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267452:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267457:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267462:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267467:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267472:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267477:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267483:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267488:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267494:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267499:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267505:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267510:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267514:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267519:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267523:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267527:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267532:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.267537:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330422.268141:0:17112:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99edc5f41200:17112] 0 exiting: rc = 1 00000100:00100000:3.0:1788330422.268486:0:17113:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99edc5f40e00:17113] 1 exiting: rc = 0 00000100:00100000:0.0:1788330422.268591:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268598:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268603:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268609:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268614:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268618:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268623:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268627:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268633:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268638:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268643:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268649:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268665:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268670:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268676:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268681:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268685:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268690:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268695:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268700:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268705:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268711:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268717:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268722:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268727:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268733:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268738:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268744:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268749:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268754:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268760:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268765:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268770:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268775:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268780:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268784:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268790:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268795:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268800:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268805:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268811:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268815:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268820:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268825:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268831:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268835:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268840:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268855:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.268861:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269056:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269062:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269066:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269071:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269076:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269081:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269087:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269093:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269097:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269103:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269107:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269113:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269118:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269122:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269127:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.269621:0:17114:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff99edc5f40600:17114] 0 exiting: rc = 1 00000100:00100000:2.0:1788330422.269757:0:17115:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99edc5f41800:17115] 1 exiting: rc = 0 00000100:00100000:0.0:1788330422.269851:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.269858:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270072:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270080:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270085:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270089:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270095:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270100:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270105:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270109:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270114:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270119:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270124:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270129:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270135:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270140:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270321:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270331:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270349:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270354:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270360:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270365:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270371:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270376:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270381:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270386:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270391:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270396:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270401:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270407:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270412:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270418:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270423:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270429:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270434:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270439:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270445:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270451:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270456:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270461:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270467:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270472:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270477:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270484:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270489:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270495:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270501:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270506:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270511:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270517:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270522:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270528:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270533:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270546:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270551:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270557:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270562:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270567:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270572:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270578:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270584:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270588:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270593:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330422.270599:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.271457:0:17116:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff99eec72b2c00:17116] 0 exiting: rc = 1 00000100:00100000:1.0:1788330422.271686:0:17118:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99edc5f26200:17118] 2 exiting: rc = 0 00000100:00100000:2.0:1788330422.271969:0:17117:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99edc5f27c00:17117] 1 exiting: rc = 0 00000100:00100000:3.0:1788330422.272069:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272078:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272083:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272089:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272094:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272100:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272106:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272112:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272119:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272125:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272131:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272137:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272143:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272175:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272183:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272199:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272229:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272237:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272243:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272249:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272255:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272262:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272283:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272291:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272297:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272303:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272310:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272316:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272322:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272328:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272335:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272342:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272348:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272354:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272359:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272364:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272370:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272375:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272381:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272387:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272408:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272415:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272421:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272427:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272433:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272439:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272444:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272450:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272456:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272462:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272468:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272474:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272480:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272486:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272492:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272498:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272504:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272517:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272522:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272527:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272532:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272536:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272542:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330422.272548:0:20878:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788330422.277322:0:20878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330422.277340:0:20878:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788330422.277346:0:20878:0:(genops.c:885:class_export_put()) final put ffff99edc7eaa800/MDS_uuid 00000020:00000080:3.0:1788330422.277352:0:20878:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7eaa800/MDS_uuid for MDS 00000020:01000000:3.0:1788330422.277358:0:20878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788330422.277531:0:20878:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:1.0:1788330422.683385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330422.683400:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330422.683404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330422.683428:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788330422.683434:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc6580800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330422.683448:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 621 00000100:00080000:1.0:1788330422.683457:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788330422.683467:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99edc6580800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330422.683533:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eed82d1c00 x1875199792490880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330422.683616:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330422.683621:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788330422.683623:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eedef8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330422.683628:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 621 00000100:00080000:1.0:1788330422.683632:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788330422.683636:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99eedef8b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330422.683651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eed82d2d80 x1875199792491136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330422.683687:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792490880:0@lo:38:kworker.0 00000100:00100000:1.0:1788330422.683712:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330422.683739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792491008:0@lo:400:kworker.0 00000400:00000100:0.0:1788330422.683783:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792490880 offset 0 length 520: 4 00000400:00000100:1.0:1788330422.683898:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792491008 offset 0 length 224: 4 00000100:00100000:0.0:1788330422.684352:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792491136:0@lo:38:kworker.0 00000400:00000100:0.0:1788330422.684386:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792491136 offset 0 length 520: 4 00000100:00100000:3.0:1788330422.684718:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792491264:0@lo:400:kworker.0 00000400:00000100:3.0:1788330422.684754:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792491264 offset 0 length 224: 4 00010000:00010000:1.0:1788330423.133356:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330424.157940:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330425.180419:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330426.206336:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788330426.234724:0:21079:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788330426.248455:0:21079:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788330426.248505:0:21079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330426.248536:0:21079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330426.248541:0:21079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330426.248545:0:21079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330426.248595:0:21079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788330426.248600:0:21079:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788330426.248624:0:21079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330426.248634:0:21079:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d1c00 x1875199792490880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330426.248649:0:21079:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788330426.248654:0:21079:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788330426.248659:0:21079:0:(import.c:65:import_set_state_nolock()) ffff99edc6580800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788330426.248662:0:21079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330426.248664:0:21079:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d1c00 x1875199792490880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330437 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330426.248669:0:21079:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788330426.248671:0:21079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1788330426.248791:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792490880:0@lo:38:kworker.0 00010000:00010000:0.0:1788330426.248946:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330426.248953:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330426.248962:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038c00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330426.248966:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330426.248976:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330426.248985:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330426.248990:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788330426.248999:0:17091:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788330426.249002:0:17091:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788330426.249016:0:17091:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99edc67e9000 00010000:00010000:0.0:1788330426.249019:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330426.249027:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330426.249040:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330426.249042:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330426.249044:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788330426.249806:0:21079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330426.249865:0:21079:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d0a80 x1875199792491008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330426.249879:0:21079:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788330426.249884:0:21079:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788330426.249919:0:21079:0:(import.c:65:import_set_state_nolock()) ffff99edc7f1e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788330426.249925:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792491008:0@lo:400:kworker.0 00000100:00100000:3.0:1788330426.249985:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792491392:0@lo:39:umount.0 00000400:00000100:3.0:1788330426.250034:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792491392 offset 0 length 224: 4 00000100:00080000:1.0:1788330426.715744:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330426.715756:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330426.715759:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330426.715860:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330426.715972:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330426.720137:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792491520:0@lo:400:kworker.0 00000400:00000100:2.0:1788330426.720534:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792491520 offset 0 length 224: 4 00010000:00010000:3.0:1788330427.232964:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330427.739308:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330427.739320:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330427.739324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330427.739327:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330427.739478:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330427.739498:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792491648:0@lo:400:kworker.0 00000400:00000100:0.0:1788330427.739685:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792491648 offset 0 length 224: 4 00000001:00100000:0.0:1788330427.810764:0:19426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788330427.810778:0:19426:0:(genops.c:885:class_export_put()) final put ffff99edc64ad800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788330427.813212:0:18607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788330427.813222:0:18607:0:(genops.c:885:class_export_put()) final put ffff99eee7276000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788330427.814045:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc64ad800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788330427.814123:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc64a8800 for lustre-OST0001 00000020:00000080:0.0:1788330427.815647:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7276000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788330427.815726:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eee7271000 for lustre-OST0000 00010000:00010000:1.0:1788330428.254007:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330429.275361:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330430.299428:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330431.326396:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330431.387319:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330421/real 1788330421] req@ffff99edc72fd880 x1875199792490752/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788330431 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330431.387357:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc72fd880 x1875199792490752/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788330431 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330431.387379:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330431.387430:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788330431.387436:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3645:1875199792490752:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1788330431.387568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788330431.388926:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788330431.388931:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330431.388939:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 625 00000100:00080000:0.0:1788330431.388945:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788330431.388952:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.150@tcp: import ffff99edc67e9000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330431.388995:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffc9b100 x1875199792491776/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330431.389038:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788330431.389042:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788330431.389329:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3645:1875199792491776:0@lo:250:kworker.0 00000400:00000100:1.0:1788330431.389399:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875199792491776 offset 0 length 520: 4 00000100:00100000:3.0:1788330431.390820:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792491904:0@lo:400:kworker.0 00000400:00000100:3.0:1788330431.390871:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792491904 offset 0 length 224: 4 00010000:00010000:0.0:1788330432.348487:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330433.371404:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330434.397443:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330435.420783:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330436.443464:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330436.507527:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330426/real 1788330426] req@ffff99edc72fed80 x1875199792491392/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788330436 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330436.507577:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc72fed80 x1875199792491392/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788330436 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330436.507623:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7f1e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788330436.507646:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792491392:0@lo:39:umount.0 00000100:00080000:2.0:1788330436.507850:0:21079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330436.507855:0:21079:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788330436.507860:0:21079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788330436.508948:0:21079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330436.508964:0:21079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330436.508972:0:21079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330436.508979:0:21079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330436.509006:0:21079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330436.509014:0:21079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330436.509021:0:21079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330436.509028:0:21079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330436.509058:0:21079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330436.509075:0:21079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788330436.509080:0:21079:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788330436.509107:0:21079:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788330436.509111:0:21079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788330436.509116:0:21079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330436.509122:0:21079:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788330436.509126:0:21079:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff99eee7574d28) has no exports 00000020:00080000:2.0:1788330436.509176:0:21079:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff99eee7574d28) has no exports 00010000:00010000:0.0:1788330436.511001:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330436.511015:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330436.511026:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330436.511030:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330436.511039:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330436.511046:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330436.511062:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788330436.511065:0:17091:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788330436.511068:0:17091:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788330436.511092:0:17091:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99edc67e9000 00010000:00010000:0.0:1788330436.511096:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330436.511102:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330436.511119:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330436.511143:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330436.511179:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330436.511183:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330436.511190:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330436.511196:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330436.511202:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788330436.511205:0:17091:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788330436.511207:0:17091:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788330436.511214:0:17091:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99edc67e9000 00010000:00010000:0.0:1788330436.511217:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330436.511224:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330436.511233:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330436.511235:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330436.511237:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330436.511313:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330436.511640:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330436.511646:0:13408:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330436.511650:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330436.511660:0:13408:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788330436.511810:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330436.511833:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792492032:0@lo:400:kworker.0 00000400:00000100:3.0:1788330436.511895:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792492032 offset 0 length 224: 4 00000020:01000000:2.0:1788330436.520847:0:21079:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eef41267e0 - data ffff99eedf87de58/ffff99edc5faa400 00000020:01000000:2.0:1788330436.521044:0:21079:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99edc5f94f60 - data ffff99eedfac5af8/ffff99edc7331400 00100000:10000000:2.0:1788330436.542578:0:21079:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788330436.554684:0:21079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd221c 00000020:00000080:1.0:1788330436.554699:0:21079:0:(genops.c:885:class_export_put()) final put ffff99eec961d800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788330436.554789:0:21079:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eec91d5800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788330436.554794:0:21079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eec91d5800 2 00000020:01000004:1.0:1788330436.554799:0:21079:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99eec91d5800 from lustre-OST0000 00000020:00000080:1.0:1788330436.554833:0:21079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330436.554850:0:21079:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788330436.554854:0:21079:0:(genops.c:885:class_export_put()) final put ffff99edc7e26000/lustre-OST0000_UUID 00000020:00000080:1.0:1788330436.554858:0:21079:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7e26000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788330436.554868:0:21079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788330436.554933:0:21079:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788330436.554939:0:21079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788330436.554944:0:21079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330436.554951:0:21079:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788330436.554961:0:21079:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99edc6583800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788330436.554967:0:21079:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff99eee764cd28) has exports, disconnecting them 00000020:00080000:1.0:1788330436.554974:0:21079:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99edc6583800), last request at 1788330352 00000020:00000080:1.0:1788330436.554978:0:21079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2246 00000020:00080000:1.0:1788330436.554988:0:21079:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc6583800): rc 0 00000020:00000080:1.0:1788330436.554995:0:21079:0:(genops.c:885:class_export_put()) final put ffff99edc6583800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788330436.559491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec961d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788330436.563318:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc6583800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788330436.582303:0:21079:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788330436.582317:0:21079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330436.582323:0:21079:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788330436.582335:0:21079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330436.582640:0:21079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330436.582654:0:21079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788330436.582663:0:21079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788330436.582674:0:21079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330436.582680:0:21079:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788330436.582689:0:21079:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff99edc7f1f000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788330436.582697:0:21079:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff99eee76499b8) has exports, disconnecting them 00000020:00080000:2.0:1788330436.582702:0:21079:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff99edc7f1f000), last request at 1788330352 00000020:00000080:2.0:1788330436.582724:0:21079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd225b 00000020:00080000:2.0:1788330436.582748:0:21079:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc7f1f000): rc 0 00000020:00000080:2.0:1788330436.582754:0:21079:0:(genops.c:885:class_export_put()) final put ffff99edc7f1f000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788330436.583572:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc6580800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788330436.583584:0:37:0:(genops.c:885:class_export_put()) final put ffff99edc6586800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788330436.583587:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc6586800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788330436.583597:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788330436.583693:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7f1f000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788330436.583728:0:21079:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788330436.583732:0:21079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788330436.583737:0:21079:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788330436.583742:0:21079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788330436.583763:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7f1e000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788330436.583917:0:21079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330436.583924:0:21079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788330436.583928:0:21079:0:(genops.c:885:class_export_put()) final put ffff99edc6585000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788330436.583931:0:21079:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc6585000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788330436.583935:0:21079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788330436.583966:0:21079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eec91d5800 1 00000020:00000080:3.0:1788330436.583972:0:21079:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd21f9 00000020:00000080:3.0:1788330436.583977:0:21079:0:(genops.c:885:class_export_put()) final put ffff99eec91d4000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788330436.583986:0:21079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788330436.583993:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec91d4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788330436.584003:0:21079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330436.584007:0:21079:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788330436.584020:0:21079:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff99eec8bb4d28) has no exports 00000020:00000080:3.0:1788330436.693937:0:21079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330436.693952:0:21079:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788330436.693958:0:21079:0:(genops.c:885:class_export_put()) final put ffff99eec91d0800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788330436.693963:0:21079:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec91d0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788330436.693975:0:21079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788330436.696563:0:21079:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99eec91d3800 00000020:02000400:3.0:1788330436.697519:0:21079:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788330437.478675:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330437.541286:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330422/real 1788330422] req@ffff99eed82d2d80 x1875199792491136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788330437 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330437.541329:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eed82d2d80 x1875199792491136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788330437 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330437.541364:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eedef8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330437.541387:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788330437.541392:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792491136:0@lo:38:kworker.0 00000100:00080000:1.0:1788330437.541432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330437.541438:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330437.541440:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330437.541444:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788330437.541447:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eedef8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330437.541452:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 626 00000100:00080000:1.0:1788330437.541458:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788330437.541466:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99eedef8b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330437.541508:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eed82d2d80 x1875199792492160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330437.541562:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330437.541576:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792492288:0@lo:400:kworker.0 00000400:00000100:1.0:1788330437.541644:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792492288 offset 0 length 224: 4 00000100:00100000:1.0:1788330437.541728:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792492160:0@lo:38:kworker.0 00000400:00000100:1.0:1788330437.541744:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792492160 offset 0 length 520: 4 00010000:00010000:0.0:1788330438.493590:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788330438.556835:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330422/real 1788330422] req@ffff99eed82d3480 x1875199792491264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788330438 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330438.591990:0:3648:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99eed82d3480 x1875199792491264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788330438 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330438.592010:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99edc5da7000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788330438.592014:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788330438.627829:0:3648:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788330438.631688:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330438.631701:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330438.631705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330438.631710:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330438.631738:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330438.631743:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788330438.631748:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc5da7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330438.631759:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 575 00000100:00080000:1.0:1788330438.631771:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99edc5da7000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330438.631821:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eed82d2300 x1875199792492416/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330438.631975:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792492416:0@lo:38:kworker.0 00000400:00000100:3.0:1788330438.632063:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792492416 offset 0 length 520: 4 00000100:00100000:2.0:1788330438.640755:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792491264:0@lo:400:kworker.0 00010000:00010000:3.0:1788330439.516600:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330440.539844:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330441.564559:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788330441.603858:0:21282:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788330441.619328:0:21282:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788330441.619430:0:21282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.619450:0:21282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.619458:0:21282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.619466:0:21282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.619499:0:21282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788330441.619506:0:21282:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788330441.619541:0:21282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330441.619557:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d2d80 x1875199792492160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330457 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.619591:0:21282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788330441.619599:0:21282:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788330441.619607:0:21282:0:(import.c:65:import_set_state_nolock()) ffff99eedef8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788330441.619613:0:21282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330441.619617:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d2d80 x1875199792492160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330457 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.619655:0:21282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788330441.619659:0:21282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00010000:00010000:3.0:1788330441.619774:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330441.619782:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.619791:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330441.619796:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.619818:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330441.619826:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330441.619832:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330441.619835:0:17092:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788330441.619837:0:17092:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788330441.619867:0:17092:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99edc67e9000 00010000:00010000:3.0:1788330441.619871:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.619878:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.619890:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330441.619892:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330441.619893:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330441.620001:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792492160:0@lo:38:kworker.0 00000100:00080000:2.0:1788330441.625390:0:21282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330441.625412:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d0a80 x1875199792491520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330442 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625436:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d3b80 x1875199792491648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330443 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625452:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eeffc98000 x1875199792491904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330447 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625460:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eec995e300 x1875199792492032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330452 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625480:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d1c00 x1875199792492288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330453 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625489:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d2300 x1875199792492416/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330448 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625511:0:21282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788330441.625561:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5da7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330441.625566:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788330441.625570:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792492416:0@lo:38:kworker.0 00000100:00080000:2.0:1788330441.625604:0:21282:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788330441.625610:0:21282:0:(import.c:65:import_set_state_nolock()) ffff99edc5da7000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788330441.625616:0:21282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330441.625620:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d0a80 x1875199792491520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330442 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625628:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d3b80 x1875199792491648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330443 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625653:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eeffc98000 x1875199792491904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330447 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625660:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eec995e300 x1875199792492032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330452 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625668:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eed82d1c00 x1875199792492288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330453 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330441.625674:0:21282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788330441.625677:0:21282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1788330441.625858:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792492288:0@lo:400:kworker.0 00000100:00100000:3.0:1788330441.625871:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792491520:0@lo:400:kworker.0 00000100:00100000:0.0:1788330441.626088:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792491904:0@lo:400:kworker.0 00000100:00100000:0.0:1788330441.626109:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792491648:0@lo:400:kworker.0 00000100:00100000:1.0:1788330441.626273:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792492032:0@lo:400:kworker.0 00010000:00010000:2.0:1788330441.629893:0:21282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.629913:0:21282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.629921:0:21282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.629928:0:21282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.630041:0:21282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330441.630052:0:21282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.630059:0:21282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.630065:0:21282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330441.630088:0:21282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.634991:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330441.635020:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.635034:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91a200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330441.635038:0:17858:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.635080:0:17858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330441.635088:0:17858:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330441.635093:0:17858:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330441.635096:0:17858:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788330441.635113:0:17858:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99edc67e9000 00010000:00010000:3.0:1788330441.635118:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.635125:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.635145:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330441.635165:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.635171:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78c00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330441.635173:0:17858:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.635179:0:17858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330441.635185:0:17858:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330441.635201:0:17858:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788330441.635204:0:17858:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788330441.635210:0:17858:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99edc67e9000 00010000:00010000:3.0:1788330441.635213:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330441.635220:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330441.635222:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330441.635224:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330441.635403:0:21282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788330441.635413:0:21282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330441.635435:0:21282:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788330441.635440:0:21282:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788330441.635443:0:21282:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788330441.635485:0:21282:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788330441.635489:0:21282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788330441.635496:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330441.635503:0:21282:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788330441.635507:0:21282:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff99eefd3319b8) has no exports 00000020:00080000:2.0:1788330441.635536:0:21282:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff99eefd3319b8) has no exports 00000020:01000000:2.0:1788330441.640928:0:21282:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eef41269c0 - data ffff99eedfb41af8/ffff99eee5e39c00 00000020:01000000:2.0:1788330441.641125:0:21282:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99edc16dad80 - data ffff99edc59a9bd0/ffff99edc76ef800 00010000:00010000:0.0:1788330441.641233:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788330441.651071:0:21282:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788330441.672377:0:21282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2381 00000020:00000080:0.0:1788330441.672396:0:21282:0:(genops.c:885:class_export_put()) final put ffff99eedef8d800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788330441.672420:0:21282:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7f1d000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788330441.672424:0:21282:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7f1d000 2 00000020:01000004:0.0:1788330441.672429:0:21282:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99edc7f1d000 from lustre-OST0001 00000020:00000080:0.0:1788330441.672461:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330441.672472:0:21282:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788330441.672476:0:21282:0:(genops.c:885:class_export_put()) final put ffff99eedef89000/lustre-OST0001_UUID 00000020:00000080:0.0:1788330441.672480:0:21282:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedef89000/lustre-OST0001_UUID for lustre-OST0001 00000020:00000080:1.0:1788330441.672487:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedef8d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788330441.672495:0:21282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788330441.672624:0:21282:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS 00010000:00010000:0.0:1788330441.672652:0:21282:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd20cc expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330441.672666:0:21282:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd20cc expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330441.672673:0:21282:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788330441.672675:0:21282:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788330441.672678:0:21282:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788330441.672692:0:21282:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99edc67e9000 00010000:00010000:0.0:1788330441.672696:0:21282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd20cc expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330441.672710:0:21282:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330441.672717:0:21282:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330441.672733:0:21282:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788330441.672735:0:21282:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788330441.672737:0:21282:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788330441.672746:0:21282:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99edc67e9000 00010000:00010000:0.0:1788330441.672749:0:21282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330441.672766:0:21282:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788330441.672770:0:21282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788330441.672772:0:21282:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788330441.672774:0:21282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788330441.672778:0:21282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788330441.672788:0:21282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eeffc9b100 x1875199792491776/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788330446 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788330441.672807:0:21282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788330441.672809:0:21282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1788330441.672953:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3645:1875199792491776:0@lo:250:kworker.0 10000000:01000000:0.0:1788330441.673833:0:21282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788330441.673849:0:21282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd1f9f 00000020:00000080:0.0:1788330441.673856:0:21282:0:(genops.c:885:class_export_put()) final put ffff99edc7eae800/6efb806c-ba9f-4d20-bba3-c0a9c1d82585 00000020:01000000:0.0:1788330441.673872:0:21282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.150@tcp (flags='') 00000020:00000080:0.0:1788330441.673882:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330441.673889:0:21282:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788330441.673893:0:21282:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff99edc67d8000) has no exports 00000020:00000080:1.0:1788330441.673930:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7eae800/6efb806c-ba9f-4d20-bba3-c0a9c1d82585 for MGC192.168.202.150@tcp 10000000:01000000:3.0:1788330441.674202:0:17101:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788330441.674431:0:21282:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.150@tcp: client import never connected 00000100:00080000:0.0:1788330441.674436:0:21282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788330441.674440:0:21282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788330441.674443:0:21282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788330441.674445:0:21282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788330441.674500:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330441.674507:0:21282:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.150@tcp (uuid 6efb806c-ba9f-4d20-bba3-c0a9c1d82585) 00000020:01000000:0.0:1788330441.674514:0:21282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788330441.674528:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330441.674533:0:21282:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788330441.674540:0:21282:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99eedef8c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788330441.674545:0:21282:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff99eefd330000) has exports, disconnecting them 00000020:00080000:0.0:1788330441.674550:0:21282:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99eedef8c800), last request at 1788330371 00000020:00000080:0.0:1788330441.674555:0:21282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd23ab 00000020:00080000:0.0:1788330441.674569:0:21282:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eedef8c800): rc 0 00000020:00000080:0.0:1788330441.674574:0:21282:0:(genops.c:885:class_export_put()) final put ffff99eedef8c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788330441.674578:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc67e9000 for MGC192.168.202.150@tcp 00000020:00000080:1.0:1788330441.674595:0:37:0:(genops.c:885:class_export_put()) final put ffff99edc67ee800/6efb806c-ba9f-4d20-bba3-c0a9c1d82585 00000020:00000080:1.0:1788330441.674598:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc67ee800/6efb806c-ba9f-4d20-bba3-c0a9c1d82585 for MGC192.168.202.150@tcp 00000020:01000000:1.0:1788330441.674606:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.150@tcp (6efb806c-ba9f-4d20-bba3-c0a9c1d82585) 00000020:00000080:1.0:1788330441.675350:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedef8c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788330441.676247:0:21282:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788330441.676255:0:21282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788330441.676261:0:21282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788330441.676269:0:21282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330441.676655:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eedef8b000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788330441.678059:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330441.678078:0:21282:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788330441.678086:0:21282:0:(genops.c:885:class_export_put()) final put ffff99eedef8f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788330441.678092:0:21282:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedef8f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788330441.678103:0:21282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788330441.678237:0:21282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788330441.678242:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330441.678249:0:21282:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788330441.678260:0:21282:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff99edc5da1800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788330441.678268:0:21282:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff99eefd334d28) has exports, disconnecting them 00000020:00080000:1.0:1788330441.678275:0:21282:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff99edc5da1800), last request at 1788330371 00000020:00000080:1.0:1788330441.678281:0:21282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd23c0 00000020:00080000:1.0:1788330441.678313:0:21282:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc5da1800): rc 0 00000020:00000080:1.0:1788330441.678319:0:21282:0:(genops.c:885:class_export_put()) final put ffff99edc5da1800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788330441.678371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5da1800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788330441.712335:0:21282:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788330441.712356:0:21282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330441.712362:0:21282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788330441.712371:0:21282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330441.712416:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5da7000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788330441.720681:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788330441.726691:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788330441.726806:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788330441.731901:0:17086:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99eef5923c00:17086] 0 exiting: rc = 1 00000100:00100000:0.0:1788330441.732033:0:17087:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99eef5923e00:17087] 1 exiting: rc = 0 00000100:00100000:2.0:1788330441.732558:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.742351:0:17088:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99eef5b78800:17088] 0 exiting: rc = 1 00000100:00100000:2.0:1788330441.743624:0:17089:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99eef5a94200:17089] 1 exiting: rc = 0 00000100:00100000:2.0:1788330441.743729:0:17090:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99eef5a95400:17090] 2 exiting: rc = 0 00000100:00100000:2.0:1788330441.745816:0:19442:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99edc64a3000:19442] 3 exiting: rc = 0 00000100:00100000:0.0:1788330441.747228:0:20133:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff99eefcd70000:20133] 4 exiting: rc = 0 00000100:00100000:2.0:1788330441.747371:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747387:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747394:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747401:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747418:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747878:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747887:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747893:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747900:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747907:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747914:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747920:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747926:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747931:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747936:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747941:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747946:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747952:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747957:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747963:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747968:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747974:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747980:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747987:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.747994:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748011:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748018:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748024:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748030:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748036:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748067:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748074:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748079:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748085:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748090:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748096:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748102:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748108:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748114:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748120:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748135:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748142:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748148:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748187:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748195:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748201:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748206:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748218:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748224:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748239:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748245:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748251:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748257:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748263:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748269:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748275:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748282:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748288:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748294:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748299:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748305:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748311:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748317:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.748324:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788330441.752836:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330441.752871:0:21282:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788330441.752878:0:21282:0:(genops.c:885:class_export_put()) final put ffff99eedef88800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788330441.752883:0:21282:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedef88800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788330441.752897:0:21282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788330441.752965:0:21282:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7f1d000 1 00000020:00000080:2.0:1788330441.752972:0:21282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd2365 00000020:00000080:2.0:1788330441.752980:0:21282:0:(genops.c:885:class_export_put()) final put ffff99edc7374000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788330441.752996:0:21282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788330441.753020:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7374000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788330441.753035:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330441.753040:0:21282:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788330441.753044:0:21282:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff99eee764b370) has no exports 00000020:00000080:2.0:1788330441.870777:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330441.870795:0:21282:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788330441.870801:0:21282:0:(genops.c:885:class_export_put()) final put ffff99edc7f19800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788330441.870805:0:21282:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7f19800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788330441.870819:0:21282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788330441.871231:0:21282:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99edc7f19000 00000020:01000000:2.0:1788330441.871253:0:21282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788330441.871258:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330441.871262:0:21282:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788330441.871267:0:21282:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff99eee75719b8) has no exports 00000020:00000080:2.0:1788330441.871297:0:21282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330441.871303:0:21282:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788330441.871306:0:21282:0:(genops.c:885:class_export_put()) final put ffff99eededf4800/OSS_uuid 00000020:00000080:2.0:1788330441.871309:0:21282:0:(genops.c:844:class_export_destroy()) destroying export ffff99eededf4800/OSS_uuid for OSS 00000020:01000000:2.0:1788330441.871313:0:21282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788330441.871399:0:17099:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788330441.871424:0:18613:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff99edc7301000:18613] 2 exiting: rc = 0 00000100:00100000:3.0:1788330441.885374:0:18802:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99edc5f6de00:18802] 3 exiting: rc = 0 00000100:00100000:3.0:1788330441.885509:0:18610:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99edc7300400:18610] 0 exiting: rc = 1 00000100:00100000:3.0:1788330441.885575:0:18612:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff99eecad8f000:18612] 1 exiting: rc = 0 00000100:00100000:2.0:1788330441.885635:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885647:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885655:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885664:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885683:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885688:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885702:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885708:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885714:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885719:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885725:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885731:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885736:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885743:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885749:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885755:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885760:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885765:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885770:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885775:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885780:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885785:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885790:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885795:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885801:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885806:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885811:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885828:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885833:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885839:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885844:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885848:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885854:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885858:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885863:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885869:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885875:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885880:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885887:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885902:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885907:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885912:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885917:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885923:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885929:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885935:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885940:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885946:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885951:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885956:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885962:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885966:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885971:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885977:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885983:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885988:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885993:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.885998:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.886013:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.886018:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.886026:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.886032:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.886044:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.886052:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330441.887286:0:18615:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99edc7300e00:18615] 1 exiting: rc = 0 00000100:00100000:0.0:1788330441.888972:0:18614:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99edc7301200:18614] 0 exiting: rc = 1 00000100:00100000:2.0:1788330441.890799:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890820:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890825:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890830:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890834:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890840:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890844:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890849:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890854:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890858:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890879:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890886:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890891:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890896:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890901:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890906:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890912:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890917:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890921:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890926:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890932:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890938:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890942:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890948:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890953:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890958:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890963:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890969:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890974:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890978:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890983:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890989:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.890994:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891009:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891017:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891022:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891027:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891033:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891038:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891043:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891049:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891056:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891062:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891067:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891071:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891084:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891090:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891096:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891102:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891107:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891113:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891118:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891122:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891128:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891133:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891138:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891143:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891148:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891202:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891207:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891212:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891217:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891222:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.891228:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330441.906704:0:18616:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99edc5f27e00:18616] 0 exiting: rc = 1 00000100:00100000:0.0:1788330441.906980:0:18617:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99eedee0da00:18617] 1 exiting: rc = 0 00000100:00100000:0.0:1788330441.907223:0:20247:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff99edc73d5a00:20247] 3 exiting: rc = 0 00000100:00100000:0.0:1788330441.907376:0:18618:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99eec5ce9000:18618] 2 exiting: rc = 0 00000100:00100000:2.0:1788330441.910455:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910470:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910486:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910498:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910505:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910511:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910516:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910523:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910529:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910536:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910541:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910565:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910575:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910582:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910589:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910595:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910615:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910622:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910631:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910638:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910645:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910652:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910658:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910665:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910671:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910677:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910684:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910689:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910695:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910702:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910707:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910714:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910720:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910726:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910732:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910755:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910763:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910770:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910776:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910782:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910787:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910793:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910800:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910824:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910831:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910837:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910843:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910849:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910855:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910861:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910873:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910888:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910893:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910900:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910906:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910911:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910917:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910924:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910931:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910937:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910943:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910949:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910955:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.910961:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330441.941254:0:18619:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99edc76d8800:18619] 0 exiting: rc = 1 00000100:00100000:0.0:1788330441.941416:0:18620:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99edc76d9a00:18620] 1 exiting: rc = 0 00000100:00100000:2.0:1788330441.942261:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942270:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942276:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942286:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942291:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942296:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942303:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942309:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942314:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942319:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942325:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942947:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942959:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942964:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942969:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942974:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942978:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942983:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942988:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.942993:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943009:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943016:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943040:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943045:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943050:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943055:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943061:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943066:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943072:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943077:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943083:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943088:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943094:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943100:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943105:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943111:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943117:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943124:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943129:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943135:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943141:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943146:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943183:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943190:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943196:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943204:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943210:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943215:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943220:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943226:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943233:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943239:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943244:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943250:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943255:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943260:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943265:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943279:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943284:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943290:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943295:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943300:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943306:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330441.943311:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.972572:0:18621:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99eec8c5ac00:18621] 0 exiting: rc = 1 00000100:00100000:1.0:1788330441.974245:0:18622:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99eec8c5a400:18622] 1 exiting: rc = 0 00000100:00100000:3.0:1788330441.974325:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974336:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974347:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974355:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974384:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974392:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974398:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974405:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974411:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974417:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974424:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974430:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974438:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974452:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974458:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974479:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974501:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974508:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974514:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974520:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974526:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974532:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974538:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974544:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974555:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974561:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974567:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974573:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974593:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974601:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974607:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974613:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974620:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974626:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974632:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974638:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974644:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974650:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974656:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974663:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974682:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974690:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974698:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974704:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974715:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974722:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974731:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974737:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974744:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974750:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974763:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974773:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974793:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974800:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974805:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974812:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974818:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974824:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974830:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974837:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974843:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974849:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974856:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330441.974863:0:21282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788330442.005314:0:21282:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788330463.651578:0:22046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788330474.845114:0:22648:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788330474.845122:0:22648:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788330474.845123:0:22648:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788330474.845295:0:22648:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99eee7213000 00000020:01000004:1.0:1788330474.845310:0:22648:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788330474.845318:0:22648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788330474.845333:0:22648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99eefd330000) 00000020:00000080:1.0:1788330474.845347:0:22648:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788330474.889381:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788330474.889951:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788330474.891841:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788330474.892100:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788330474.892400:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788330474.892604:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788330474.892834:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788330474.893207:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788330474.893410:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788330474.893612:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788330474.893829:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788330474.894028:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788330474.894812:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788330474.895116:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788330474.896219:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.896476:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.896721:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.896962:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.897185:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.897659:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.897925:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.898130:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.898618:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.898868:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.902234:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.902681:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.902982:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.903251:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.903509:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.903788:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.904039:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.904361:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.904571:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.904922:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.905228:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.906891:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.907370:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.907583:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.907821:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.908032:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.908311:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.908521:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.909917:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.910365:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.910627:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788330474.910911:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788330474.912933:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788330474.915665:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788330474.916195:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788330474.916430:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788330474.917005:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788330474.917229:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788330474.917511:0:22648:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1788330474.919468:0:22648:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788330474.919747:0:22648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788330474.919757:0:22648:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788330474.919771:0:22648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd280b 00000020:01000004:2.0:1788330474.919778:0:22648:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788330474.919783:0:22648:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788330474.919787:0:22648:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99eee7213000 from MGS 00000020:01000004:2.0:1788330474.919791:0:22648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788330474.919802:0:22648:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99eec8bb19b8) 00000020:00000080:2.0:1788330474.919814:0:22648:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788330474.919895:0:22648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eee7213000 from MGS, refs=2 00080000:01000000:2.0:1788330474.919901:0:22648:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788330474.919907:0:22648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd2819 00000100:00100000:2.0:1788330474.920009:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788330474.920244:0:22648:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788330474.920251:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788330474.920983:0:22648:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788330474.920991:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788330474.921719:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330474.921902:0:22648:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788330474.921908:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788330474.926556:0:22648:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788330474.926572:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788330474.927046:0:22648:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788330474.927053:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788330474.927836:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330474.927840:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330474.927848:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330474.928435:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330474.928438:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330474.928440:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330474.929364:0:22648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:0.0:1788330474.939104:0:22648:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:3.0:1788330474.947819:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788330474.952313:0:22660:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788330474.956481:0:22648:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788330474.956545:0:22648:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788330474.962010:0:22648:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788330474.962376:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788330474.962563:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788330474.962570:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788330474.963180:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788330474.963188:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788330474.963508:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788330474.963516:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788330474.964879:0:22665:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788330474.964881:0:22648:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788330474.964904:0:22648:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.150@tcp' 00000020:01000004:2.0:1788330474.964906:0:22648:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788330474.964939:0:22648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.150@tcp (typ=mgc) 00000020:00000080:2.0:1788330474.964953:0:22648:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.150@tcp (ffff99eec8bb4d28) 00000020:00000080:2.0:1788330474.964968:0:22648:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788330474.965053:0:22648:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc8d64000@MGC192.168.202.150@tcp: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330474.965283:0:22648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.150@tcp-0 is initialized 00000040:01000000:2.0:1788330474.965291:0:22648:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788330474.969954:0:22666:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788330474.970081:0:22648:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.150@tcp (uuid e95a55f7-77f3-48c4-a98a-95aef9b6d238) 00000020:00000080:3.0:1788330474.970111:0:22648:0:(genops.c:1385:class_connect()) connect: client e95a55f7-77f3-48c4-a98a-95aef9b6d238, cookie 0x8475908e9fd2827 00000100:00080000:3.0:1788330474.970124:0:22648:0:(import.c:510:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330474.970131:0:22648:0:(import.c:624:import_select_connection()) MGC192.168.202.150@tcp: import ffff99edc8d64000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330474.970185:0:22648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eec995ea00 x1875199792492544/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330474.970211:0:22648:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e95a55f7-77f3-48c4-a98a-95aef9b6d238->MGS 00000020:01000004:3.0:1788330474.970232:0:22648:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788330474.970238:0:22648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788330474.970253:0:22648:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99eee76499b8) 00000020:00000080:3.0:1788330474.970267:0:22648:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788330474.970861:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3645:1875199792492544:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788330474.970941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330474.971043:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792492544 00000100:00100000:2.0:1788330474.971052:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792492544 00000100:00100000:2.0:1788330474.971089:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330474.971096:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1875199792492544:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788330474.971125:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e95a55f7-77f3-48c4-a98a-95aef9b6d238@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:2.0:1788330474.971174:0:22662:0:(genops.c:1385:class_connect()) connect: client e95a55f7-77f3-48c4-a98a-95aef9b6d238, cookie 0x8475908e9fd2835 00000100:00080000:2.0:1788330474.971330:0:22662:0:(import.c:65:import_set_state_nolock()) ffff99edc8d64800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330474.971389:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+5:3645:x1875199792492544:12345-0@lo:250:mount.lustre.0 Request processed in 291us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330474.971406:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330474.971459:0:3645:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788330474.971471:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.150@tcp: connect to target with instance 0 00000100:00080000:2.0:1788330474.971481:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788330474.971487:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788330474.971491:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc8d64000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788330474.971494:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788330474.971504:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788330474.971511:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3645:1875199792492544:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788330474.988813:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330474.989247:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788330474.989256:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788330474.992530:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788330474.992545:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788330474.993011:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788330474.993019:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788330474.993863:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330474.994051:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788330474.994056:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788330474.994623:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788330474.994631:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788330475.060138:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330475.060457:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788330475.060464:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788330475.061969:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788330475.061981:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788330475.062886:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330475.063062:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788330475.063068:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788330475.063619:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788330475.063627:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788330475.064372:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330475.064550:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788330475.064556:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788330475.065436:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788330475.065447:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788330475.067221:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330475.067406:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788330475.067418:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788330475.068120:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788330475.068128:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788330475.103892:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330475.104904:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788330475.104915:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788330475.112069:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788330475.112087:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788330475.119645:0:22648:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788330475.119668:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788330475.121995:0:22648:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788330475.122032:0:22648:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788330475.122040:0:22648:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788330475.122355:0:22648:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788330475.122408:0:22648:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788330475.122413:0:22648:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788330475.122415:0:22648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788330475.122416:0:22648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330475.122417:0:22648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330475.122419:0:22648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330475.122420:0:22648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330475.122422:0:22648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788330475.122423:0:22648:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788330475.122425:0:22648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330475.122427:0:22648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330475.122429:0:22648:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788330475.122432:0:22648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788330475.122433:0:22648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788330475.122434:0:22648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330475.122436:0:22648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330475.122437:0:22648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330475.122438:0:22648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330475.122440:0:22648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788330475.122441:0:22648:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788330475.122442:0:22648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330475.122443:0:22648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330475.122472:0:22648:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788330475.123001:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792492672:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788330475.123094:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.123213:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330475.123475:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792492672 00000100:00100000:0.0:1788330475.123485:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792492672 00000100:00100000:0.0:1788330475.123670:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330475.123680:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+5:22648:x1875199792492672:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788330475.123943:0:22664:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788330475.123948:0:22664:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788330475.123952:0:22664:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788330475.124349:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788330475.125014:0:22664:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788330475.126982:0:22685:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788330475.126990:0:22685:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788330475.126993:0:22685:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788330475.126995:0:22685:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788330475.127283:0:22685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788330475.127527:0:22664:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788330475.127539:0:22664:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788330475.129142:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+5:22648:x1875199792492672:12345-0@lo:253:mount.lustre.0 Request processed in 5454us (6038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330475.129184:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330475.129289:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792492672:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330475.129307:0:22648:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788330475.129311:0:22648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330475.129313:0:22648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788330475.129315:0:22648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330475.129316:0:22648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330475.129317:0:22648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330475.129318:0:22648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330475.129320:0:22648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788330475.129321:0:22648:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788330475.129323:0:22648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330475.129332:0:22648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788330475.129354:0:22648:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99eee7213000 from lustre-MDT0000 10000000:01000000:3.0:1788330475.129387:0:22648:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788330475.129390:0:22648:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788330475.129395:0:22648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99eec8bb4d28 10000000:01000000:3.0:1788330475.129399:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788330475.129408:0:22648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99eec8bb4d28 from 1 10000000:01000000:3.0:1788330475.129411:0:22648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788330475.129456:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.129468:0:22648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.129478:0:22648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330475.129510:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792492800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330475.129548:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.129986:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330475.130091:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792492800 00000100:00100000:2.0:1788330475.130099:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792492800 00000100:00100000:3.0:1788330475.130210:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330475.130220:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+5:22648:x1875199792492800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330475.130234:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330475.130250:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147be00/0x8475908e9fd2843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd283c expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.130276:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147be00/0x8475908e9fd2843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd283c expref: 6 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.130287:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147be00/0x8475908e9fd2843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd283c expref: 6 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.130310:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147be00, rc 0) 00000100:00100000:3.0:1788330475.130359:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+6:22648:x1875199792492800:12345-0@lo:101:mount.lustre.0 Request processed in 139us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.130365:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330475.130481:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792492800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330475.130507:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.130518:0:22648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330475.130586:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792492928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330475.130615:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.130633:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.130750:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792492928 00000100:00100000:3.0:1788330475.130754:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792492928 00000100:00100000:3.0:1788330475.130774:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330475.130781:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+6:22648:x1875199792492928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330475.130882:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+6:22648:x1875199792492928:12345-0@lo:501:mount.lustre.0 Request processed in 100us (265us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330475.130889:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330475.131015:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792492928:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788330475.131043:0:22648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788330475.131061:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.131071:0:22648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330475.131079:0:22648:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99eee7213000 10000000:01000000:2.0:1788330475.131084:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788330475.131087:0:22648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99eee7213000 10000000:01000000:2.0:1788330475.131095:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788330475.131098:0:22648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99eee7213000 from 1 10000000:01000000:2.0:1788330475.131101:0:22648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788330475.131118:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd284a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.131126:0:22648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd284a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.131135:0:22648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd284a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330475.131146:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792493056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330475.131199:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.131209:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.131269:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792493056 00000100:00100000:3.0:1788330475.131273:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792493056 00000100:00100000:3.0:1788330475.131292:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330475.131298:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+6:22648:x1875199792493056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330475.131305:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330475.131316:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147a600/0x8475908e9fd2851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd284a expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.131330:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147a600/0x8475908e9fd2851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd284a expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.131339:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147a600/0x8475908e9fd2851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd284a expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.131347:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147a600, rc 0) 00000100:00100000:3.0:1788330475.131384:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+7:22648:x1875199792493056:12345-0@lo:101:mount.lustre.0 Request processed in 86us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.131396:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330475.131504:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792493056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330475.131516:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd284a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2851 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.131523:0:22648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd284a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2851 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330475.131534:0:22648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788330475.131548:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd284a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2851 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.131556:0:22648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd284a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2851 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330475.131562:0:22648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788330475.131570:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788330475.131574:0:22648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99eee7213000 10000000:01000000:2.0:1788330475.131577:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788330475.131580:0:22648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788330475.131583:0:22648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788330475.131597:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039600/0x8475908e9fd2858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.131605:0:22648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9039600/0x8475908e9fd2858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.131613:0:22648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9039600/0x8475908e9fd2858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330475.131624:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792493184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330475.131649:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.131666:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.131840:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792493184 00000100:00100000:3.0:1788330475.131844:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792493184 00000100:00100000:3.0:1788330475.131865:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330475.131872:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+7:22648:x1875199792493184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330475.131879:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330475.131888:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147b200/0x8475908e9fd285f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2858 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.131902:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147b200/0x8475908e9fd285f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2858 expref: 8 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.131910:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147b200/0x8475908e9fd285f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2858 expref: 8 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.131916:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b200, rc 0) 00000100:00100000:3.0:1788330475.131953:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+8:22648:x1875199792493184:12345-0@lo:101:mount.lustre.0 Request processed in 82us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.131960:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330475.132031:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792493184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330475.132042:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9039600/0x8475908e9fd2858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd285f expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.132050:0:22648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9039600/0x8475908e9fd2858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd285f expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330475.132097:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792493312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330475.132121:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.132143:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.132219:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792493312 00000100:00100000:3.0:1788330475.132223:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792493312 00000100:00100000:3.0:1788330475.132240:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330475.132246:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+8:22648:x1875199792493312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330475.132384:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+9:22648:x1875199792493312:12345-0@lo:501:mount.lustre.0 Request processed in 137us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.132391:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330475.132465:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792493312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330475.132509:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792493440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330475.132548:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.132574:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.132626:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792493440 00000100:00100000:3.0:1788330475.132637:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792493440 00000100:00100000:3.0:1788330475.132655:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330475.132660:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+9:22648:x1875199792493440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330475.133402:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+9:22648:x1875199792493440:12345-0@lo:503:mount.lustre.0 Request processed in 738us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.133410:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788330475.133502:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792493440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330475.133977:0:22686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22686:1875199792493568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330475.134018:0:22686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.134050:0:22686:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.134104:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792493568 00000100:00100000:3.0:1788330475.134111:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792493568 00000100:00100000:3.0:1788330475.134135:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330475.134142:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+9:22686:x1875199792493568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330475.134620:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+9:22686:x1875199792493568:12345-0@lo:502:llog_process_th.0 Request processed in 477us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.134628:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788330475.134739:0:22686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22686:1875199792493568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330475.134765:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330475.134776:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.134778:0:22686:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788330475.134783:0:22686:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788330475.134786:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330475.134801:0:22686:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99eec8bb3370) 00000020:00000080:2.0:1788330475.134817:0:22686:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788330475.134822:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788330475.134904:0:22686:0:(osd_handler.c:8927:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788330475.134912:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd286d 00000020:00000080:2.0:1788330475.135122:0:22686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788330475.135126:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330475.135129:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.135131:0:22686:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788330475.135134:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330475.135137:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.135139:0:22686:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788330475.135142:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330475.135179:0:22686:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99eec8bb0000) 00000020:00000080:2.0:1788330475.135190:0:22686:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788330475.135200:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788330475.135202:0:22686:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788330475.135205:0:22686:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788330475.135212:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788330475.135266:0:22686:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eee7213000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788330475.135281:0:22686:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99eee75719b8) 00000020:00000080:2.0:1788330475.135289:0:22686:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788330475.135337:0:22686:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788330475.135343:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd2882 00000020:00000080:2.0:1788330475.135435:0:22686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788330475.135441:0:22686:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788330475.135446:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8475908e9fd2889 00080000:01000000:2.0:1788330475.135451:0:22686:0:(osd_handler.c:8927:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788330475.135454:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd2890 00010000:00010000:3.0:1788330475.213904:0:22686:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788330475.214679:0:22686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788330475.215347:0:22686:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788330475.216215:0:22686:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99eee764cd28) 00000020:00000080:3.0:1788330475.216238:0:22686:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788330475.216338:0:22686:0:(osd_handler.c:8927:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788330475.216347:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd289e 00000020:00000080:1.0:1788330475.217223:0:22686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788330475.224541:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8475908e9fd28a5 00000020:00000080:2.0:1788330475.228750:0:22686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788330475.228767:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330475.228776:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.228778:0:22686:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788330475.228782:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330475.228785:0:22686:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788330475.228786:0:22686:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330475.228788:0:22686:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330475.228790:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330475.228793:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.228795:0:22686:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330475.228798:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330475.228804:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.228805:0:22686:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788330475.228810:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788330475.228863:0:22686:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788330475.228877:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330475.228880:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.228881:0:22686:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788330475.228884:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330475.228895:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.228897:0:22686:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788330475.228900:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788330475.228905:0:22686:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:00000080:2.0:1788330475.228937:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330475.228955:0:22686:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99eee7574d28) 00000020:00000080:2.0:1788330475.228973:0:22686:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788330475.228979:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788330475.229253:0:22686:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788330475.229261:0:22686:0:(osd_handler.c:8927:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788330475.229270:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd28b3 00010000:00080000:2.0:1788330475.229307:0:22686:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc67e9800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330475.232324:0:22686:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788330475.233644:0:22686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330475.233662:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788330475.233734:0:22686:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788330475.233758:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd28ba 00000100:00080000:2.0:1788330475.233770:0:22686:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330475.233777:0:22686:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc67e9800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330475.233824:0:22686:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72ff100 x1875199792493696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330475.233860:0:22686:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788330475.233916:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330475.233920:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.233922:0:22686:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788330475.233925:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330475.233927:0:22686:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788330475.233929:0:22686:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330475.233930:0:22686:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330475.233932:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330475.233935:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.233942:0:22686:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330475.233946:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330475.233951:0:22686:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788330475.233955:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.233956:0:22686:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788330475.233959:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788330475.233963:0:22686:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:2.0:1788330475.233991:0:22686:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788330475.233994:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330475.234007:0:22686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99eee7570000) 00000020:00000080:2.0:1788330475.234018:0:22686:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788330475.234023:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788330475.234222:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792493696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788330475.234315:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788330475.234542:0:22686:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788330475.234549:0:22686:0:(osd_handler.c:8927:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788330475.234555:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd28c8 00010000:00080000:2.0:1788330475.234587:0:22686:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eef59c0000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.150@tcp at head 00000100:00100000:1.0:1788330475.234847:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792493696 00000100:00100000:1.0:1788330475.234856:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792493696 00000100:00100000:1.0:1788330475.234898:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330475.234907:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792493696:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788330475.234922:0:22673:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1788330475.235603:0:22686:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788330475.242611:0:22686:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788330475.243852:0:22686:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788330475.249955:0:22686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330475.251340:0:22686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788330475.262010:0:22686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788330475.265582:0:22692:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788330475.265594:0:22692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788330475.267762:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792493696:12345-0@lo:38:llog_process_th.0 Request processed in 32845us (33437us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330475.267777:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788330475.268200:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330475.268206:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788330475.268211:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792493696:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788330475.269113:0:22686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330475.269131:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788330475.269211:0:22686:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788330475.269234:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd28cf 00000100:00080000:2.0:1788330475.269243:0:22686:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330475.269248:0:22686:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99eef59c0000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330475.269286:0:22686:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72ff480 x1875199792493824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330475.269309:0:22686:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788330475.269455:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330475.269460:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.269462:0:22686:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788330475.269465:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330475.269468:0:22686:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788330475.269470:0:22686:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330475.269471:0:22686:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330475.269473:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330475.269475:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.269476:0:22686:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330475.269478:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330475.269482:0:22686:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788330475.269485:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330475.269487:0:22686:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788330475.269490:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788330475.269495:0:22686:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:2.0:1788330475.269525:0:22686:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788330475.269527:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330475.269540:0:22686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99eee7573370) 00000020:00000080:2.0:1788330475.269553:0:22686:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788330475.269557:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788330475.269630:0:22686:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788330475.269635:0:22686:0:(osd_handler.c:8927:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788330475.269641:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd28dd 00010000:00080000:2.0:1788330475.269670:0:22686:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc7d06800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.150@tcp at head 00000100:00100000:1.0:1788330475.269833:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792493824:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788330475.269887:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792493824 offset 0 length 520: 4 00010000:00010000:2.0:1788330475.270350:0:22686:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788330475.270508:0:22686:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788330475.270524:0:22686:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788330475.272538:0:22686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330475.272908:0:22686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788330475.273044:0:22686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788330475.273779:0:22694:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788330475.273791:0:22694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788330475.275239:0:22686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788330475.275254:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788330475.275306:0:22686:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788330475.275328:0:22686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd28e4 00000100:00080000:3.0:1788330475.275340:0:22686:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330475.275346:0:22686:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99edc7d06800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330475.275473:0:22686:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eec995d180 x1875199792493952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330475.275545:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792493952:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788330475.275602:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792493952 offset 0 length 520: 4 00000100:00080000:3.0:1788330475.275657:0:22686:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788330475.275737:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330475.275741:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.275743:0:22686:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788330475.275746:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330475.275749:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.275750:0:22686:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788330475.275753:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788330475.275755:0:22686:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788330475.275757:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330475.275759:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.275760:0:22686:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788330475.275762:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330475.275764:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.275766:0:22686:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788330475.275769:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788330475.275798:0:22686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22686:1875199792494080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330475.275847:0:22686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.275881:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792494080 00000100:00100000:3.0:1788330475.275886:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792494080 00000100:00100000:3.0:1788330475.275924:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330475.275932:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+9:22686:x1875199792494080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330475.276039:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+9:22686:x1875199792494080:12345-0@lo:502:llog_process_th.0 Request processed in 107us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.276048:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330475.276084:0:22686:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec9ddc780 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.276102:0:22686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22686:1875199792494080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330475.276134:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330475.276138:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.276140:0:22686:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788330475.276143:0:22686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788330475.276223:0:22648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788330475.276245:0:22648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788330475.276259:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039600/0x8475908e9fd2858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd285f expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.276270:0:22648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9039600/0x8475908e9fd2858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd285f expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330475.276279:0:22648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee7213000 from 1 10000000:01000000:3.0:1788330475.276281:0:22648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330475.276306:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.276315:0:22648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.276324:0:22648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330475.276337:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330475.276444:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.276457:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec1377240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330475.276787:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792494208 00000100:00100000:0.0:1788330475.276793:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792494208 00000100:00100000:0.0:1788330475.276833:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330475.276842:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+9:22648:x1875199792494208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330475.276852:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330475.276870:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd28eb expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330475.276892:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd28eb expref: 10 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330475.276902:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd28eb expref: 10 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330475.276924:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79600, rc 0) 00000100:00100000:0.0:1788330475.276961:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+10:22648:x1875199792494208:12345-0@lo:101:mount.lustre.0 Request processed in 120us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330475.276968:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330475.277251:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330475.277265:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.277286:0:22648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330475.277881:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494336:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788330475.277933:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.277967:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec1377240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330475.278457:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792494336 00000100:00100000:0.0:1788330475.278465:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792494336 00000100:00100000:0.0:1788330475.278513:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330475.278522:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+10:22648:x1875199792494336:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788330475.278541:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788330475.278549:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788330475.278634:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+10:22648:x1875199792494336:12345-0@lo:256:mount.lustre.0 Request processed in 112us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330475.278642:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330475.278835:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494336:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788330475.279507:0:22648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330475.279529:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.279540:0:22648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330475.279548:0:22648:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eee7213000 from 1 10000000:01000000:3.0:1788330475.279551:0:22648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330475.279587:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.279595:0:22648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.279604:0:22648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330475.279623:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330475.279666:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.284051:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec1377240 going to sleep for 11 seconds 00000100:00100000:2.0:1788330475.284138:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792494464 00000100:00100000:2.0:1788330475.284176:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792494464 00000100:00100000:2.0:1788330475.284244:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330475.284255:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+10:22648:x1875199792494464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330475.284274:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330475.284299:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd28f9 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.284328:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 11 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.284340:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 11 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.284349:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038e00, rc 0) 00000100:00100000:2.0:1788330475.284417:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22648:x1875199792494464:12345-0@lo:101:mount.lustre.0 Request processed in 164us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330475.284424:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330475.284719:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330475.284756:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.284767:0:22648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330475.284853:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330475.284891:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.284958:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec1377240 going to sleep for 11 seconds 00000100:00100000:2.0:1788330475.285093:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792494592 00000100:00100000:2.0:1788330475.285099:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792494592 00000100:00100000:2.0:1788330475.285257:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330475.285266:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22648:x1875199792494592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330475.285400:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22648:x1875199792494592:12345-0@lo:501:mount.lustre.0 Request processed in 136us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330475.285408:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330475.285505:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330475.285535:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330475.285585:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330475.289166:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8f4f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.291899:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792494720 00000100:00100000:3.0:1788330475.291915:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792494720 00000100:00100000:3.0:1788330475.291980:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788330475.291992:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22648:x1875199792494720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330475.292214:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22648:x1875199792494720:12345-0@lo:503:mount.lustre.0 Request processed in 223us (6628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.292223:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330475.293288:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792494720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330475.294604:0:22696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22696:1875199792494848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330475.294705:0:22696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.294763:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788330475.294873:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792494848 00000100:00100000:1.0:1788330475.294888:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792494848 00000100:00100000:1.0:1788330475.294928:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330475.294938:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22696:x1875199792494848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330475.295491:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22696:x1875199792494848:12345-0@lo:502:llog_process_th.0 Request processed in 552us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330475.295501:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330475.295594:0:22696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22696:1875199792494848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330475.295624:0:22696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330475.295632:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.295634:0:22696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788330475.295640:0:22696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eee7213000 00000020:00000080:3.0:1788330475.295643:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330475.295657:0:22696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330475.295660:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.295661:0:22696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788330475.295664:0:22696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330475.295666:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.295667:0:22696:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788330475.295669:0:22696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eee7213000 00000020:00000080:3.0:1788330475.295671:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330475.295749:0:22696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330475.295754:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.295755:0:22696:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788330475.295757:0:22696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330475.295760:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.295761:0:22696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788330475.295764:0:22696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eee7213000 00000020:00000080:3.0:1788330475.295766:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330475.295784:0:22696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330475.295786:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.295787:0:22696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788330475.295789:0:22696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330475.295791:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.295792:0:22696:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788330475.295795:0:22696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eee7213000 00000020:00000080:3.0:1788330475.295796:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788330475.295832:0:22696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22696:1875199792494976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330475.295873:0:22696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.295889:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788330475.303855:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792494976 00000100:00100000:2.0:1788330475.303875:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792494976 00000100:00100000:2.0:1788330475.303951:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330475.303973:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22696:x1875199792494976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330475.304208:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22696:x1875199792494976:12345-0@lo:502:llog_process_th.0 Request processed in 236us (8333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330475.304218:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330475.306503:0:22696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22696:1875199792494976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330475.306561:0:22696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330475.306571:0:22696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330475.306573:0:22696:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788330475.306578:0:22696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788330475.310258:0:22648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788330475.310307:0:22648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330475.310332:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330475.310345:0:22648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330475.310439:0:22648:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788330475.310442:0:22648:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99eee7213000 10000000:01000000:0.0:1788330475.310445:0:22648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99eee7213000 10000000:01000000:0.0:1788330475.310450:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330475.310456:0:22648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eee7213000 from 1 10000000:01000000:0.0:1788330475.310459:0:22648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788330475.310510:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd2907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330475.310519:0:22648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd2907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330475.310530:0:22648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd2907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330475.310555:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792495104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330475.310629:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330475.310677:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc6627780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330475.310924:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792495104 00000100:00100000:2.0:1788330475.310933:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792495104 00000100:00100000:2.0:1788330475.311029:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788330475.311051:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22648:x1875199792495104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330475.311064:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330475.311078:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038000/0x8475908e9fd290e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2907 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.311113:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038000/0x8475908e9fd290e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2907 expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.311124:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038000/0x8475908e9fd290e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2907 expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.311135:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038000, rc 0) 00000100:00100000:2.0:1788330475.311204:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22648:x1875199792495104:12345-0@lo:101:mount.lustre.0 Request processed in 166us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330475.311211:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330475.312675:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792495104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330475.312715:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd2907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd290e expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330475.312737:0:22648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd2907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd290e expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330475.312835:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792495232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330475.312894:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330475.312942:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc6627780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330475.313079:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792495232 00000100:00100000:1.0:1788330475.313086:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792495232 00000100:00100000:1.0:1788330475.313140:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788330475.313166:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22648:x1875199792495232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330475.313299:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22648:x1875199792495232:12345-0@lo:501:mount.lustre.0 Request processed in 151us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330475.313307:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788330475.313488:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792495232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330475.313519:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792495360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330475.313562:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330475.313589:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc6627780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330475.314837:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792495360 00000100:00100000:1.0:1788330475.314848:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792495360 00000100:00100000:1.0:1788330475.314893:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788330475.314902:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22648:x1875199792495360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330475.315027:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22648:x1875199792495360:12345-0@lo:503:mount.lustre.0 Request processed in 126us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330475.315182:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792495360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330475.315341:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330475.316329:0:22700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22700:1875199792495488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330475.316390:0:22700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330475.316465:0:22700:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc6627a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330475.319238:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792495488 00000100:00100000:2.0:1788330475.319253:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792495488 00000100:00100000:2.0:1788330475.319373:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788330475.319386:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22700:x1875199792495488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330475.319656:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22700:x1875199792495488:12345-0@lo:502:llog_process_th.0 Request processed in 272us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330475.319700:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788330475.319843:0:22700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22700:1875199792495488:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788330475.319973:0:22700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788330475.320025:0:22700:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99edc67d8000) 00000020:00000080:2.0:1788330475.320059:0:22700:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788330475.321300:0:22700:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eee7213000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788330475.321308:0:22700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eee7213000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788330475.321311:0:22700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eee7213000 4 00010000:00080000:2.0:1788330475.321360:0:22700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc7d07800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330475.333379:0:22700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788330475.333581:0:22700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788330475.333625:0:22700:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788330475.333638:0:22700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8475908e9fd291c 00000100:00080000:2.0:1788330475.333649:0:22700:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330475.333656:0:22700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99edc7d07800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330475.333709:0:22700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fca80 x1875199792495616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330475.333741:0:22700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788330475.333982:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792495616:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788330475.334058:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.334763:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792495616 00000100:00100000:2.0:1788330475.334772:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792495616 00000100:00100000:2.0:1788330475.334802:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330475.334808:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792495616:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330475.334866:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792495616:12345-0@lo:38:llog_process_th.0 Request processed in 56us (807us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788330475.334872:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330475.334912:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330475.334925:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7d07800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330475.334930:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788330475.334934:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792495616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330475.341051:0:22700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22700:1875199792495744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330475.341848:0:22700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.341894:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792495744 00000100:00100000:2.0:1788330475.341902:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792495744 00000100:00100000:2.0:1788330475.341944:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330475.341954:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22700:x1875199792495744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330475.342075:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22700:x1875199792495744:12345-0@lo:502:llog_process_th.0 Request processed in 122us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330475.342083:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330475.342279:0:22700:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330475.342301:0:22700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22700:1875199792495744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330475.342347:0:22700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22700:1875199792495872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330475.342384:0:22700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.342809:0:22700:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330475.343902:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792495872 00000100:00100000:0.0:1788330475.343912:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792495872 00000100:00100000:0.0:1788330475.344058:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788330475.344068:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22700:x1875199792495872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330475.344254:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22700:x1875199792495872:12345-0@lo:502:llog_process_th.0 Request processed in 187us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330475.344261:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788330475.348995:0:22700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22700:1875199792495872:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788330475.349060:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788330475.351212:0:22648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788330475.351243:0:22648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788330475.351269:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd2907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd290e expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.351284:0:22648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd2907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd290e expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788330475.351358:0:22648:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788330475.351360:0:22648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788330475.351361:0:22648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330475.351363:0:22648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330475.351364:0:22648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330475.351365:0:22648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330475.351367:0:22648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788330475.351368:0:22648:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788330475.351370:0:22648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330475.351372:0:22648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788330475.351376:0:22648:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788330475.351378:0:22648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788330475.351380:0:22648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788330475.351381:0:22648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330475.351382:0:22648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330475.351383:0:22648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330475.351384:0:22648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330475.351385:0:22648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788330475.351386:0:22648:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788330475.351388:0:22648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330475.351389:0:22648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788330475.351416:0:22648:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788330475.351436:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792496000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788330475.351513:0:22648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330475.351550:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330475.351576:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792496000 00000100:00100000:2.0:1788330475.351585:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792496000 00000100:00100000:2.0:1788330475.351635:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788330475.351645:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22648:x1875199792496000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788330475.351681:0:22662:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788330475.351709:0:22662:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788330475.360377:0:22662:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788330475.360400:0:22662:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788330475.360726:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22648:x1875199792496000:12345-0@lo:253:mount.lustre.0 Request processed in 9068us (9199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330475.360739:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788330475.360812:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22648:1875199792496000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788330475.360826:0:22648:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788330475.360829:0:22648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788330475.360831:0:22648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788330475.360832:0:22648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330475.360834:0:22648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330475.360835:0:22648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330475.360836:0:22648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330475.360838:0:22648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788330475.360839:0:22648:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788330475.360841:0:22648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330475.360842:0:22648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788330475.360858:0:22648:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788330475.362528:0:22684:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788330475.362541:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788330475.362572:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.362592:0:22684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd28eb expref: 11 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.362602:0:22684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.362647:0:22684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd28eb expref: 11 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.362665:0:22684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd28eb expref: 11 pid: 22663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330475.362692:0:22684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792496128:0@lo:104: 00000100:00100000:3.0:1788330475.362770:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.362823:0:22684:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330475.362872:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792496128 00000100:00100000:3.0:1788330475.362880:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792496128 00000100:00100000:3.0:1788330475.362927:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330475.362936:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:22684:x1875199792496128:12345-0@lo:104: 00010000:00010000:3.0:1788330475.362949:0:22652:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.363001:0:22652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330475.363007:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:22684:x1875199792496128:12345-0@lo:104: Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330475.363015:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788330475.363053:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330475.363060:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.363067:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147a800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330475.363071:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.363080:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330475.363087:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330475.363093:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330475.363122:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.363129:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330475.363177:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.363185:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd28eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd28f2 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.363202:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330475.363204:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330475.363206:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330475.363244:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792496256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330475.363274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330475.363316:0:22684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792496128:0@lo:104: 00010000:00010000:3.0:1788330475.363342:0:22684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330475.369641:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792496256 00000100:00100000:2.0:1788330475.369661:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792496256 00010000:00010000:2.0:1788330475.369715:0:22654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd28eb expref: 12 pid: 22663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330475.370146:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330475.370194:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:3646:x1875199792496256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330475.370212:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330475.370220:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd28eb expref: 12 pid: 22663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370234:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd28eb expref: 12 pid: 22663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370252:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79600/0x8475908e9fd28f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd28eb expref: 12 pid: 22663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370285:0:22654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370294:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788330475.370311:0:22654:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007772556s 00010000:00010000:2.0:1788330475.370316:0:22654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370322:0:22654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370331:0:22654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370337:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370344:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ba00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330475.370349:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370358:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370377:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330475.370388:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330475.370480:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:3646:x1875199792496256:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (7204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330475.370488:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788330475.374859:0:22684:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.374877:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330475.374884:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147ba00/0x8475908e9fd2923 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330475.376958:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792496256:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788330475.383694:0:22648:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1788330475.384050:0:22648:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788330475.384121:0:22707:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:0.0:1788330475.384126:0:22707:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:0.0:1788330475.384408:0:22708:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788330475.384747:0:22708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330475.386855:0:22708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788330475.386941:0:22708:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1788330475.387216:0:22648:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788330475.388070:0:22709:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99eeffc9b800 x1875199792496384/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330475.388083:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000040:01000000:2.0:1788330475.388819:0:22648:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788330475.388861:0:22648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788330475.389450:0:22648:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788330475.389459:0:22648:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788330475.389498:0:22648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330475.390674:0:22648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788330475.391479:0:22648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788330475.391519:0:22648:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788330475.392112:0:22648:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788330475.392917:0:22648:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788330475.395090:0:22648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788330475.396636:0:22648:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788330475.396672:0:22648:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7bcc169f988 00100000:10000000:2.0:1788330475.396681:0:22648:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788330475.397661:0:22648:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788330475.397677:0:22648:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788330475.397708:0:22648:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788330475.397738:0:22648:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788330475.398599:0:22648:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330475.398861:0:22648:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330476.002814:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330476.380745:0:22703:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788330476.380756:0:22703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330476.381908:0:22703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788330476.381919:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788330476.447229:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 10000000:01000000:0.0:1788330476.645009:0:22666:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788330476.645018:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee7213000 from 11 10000000:01000000:0.0:1788330476.645023:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788330476.645070:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330476.645084:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330476.645110:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330476.645139:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792496512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330476.645275:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330476.645342:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330476.645374:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792496512 00000100:00100000:1.0:1788330476.645383:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792496512 00000100:00100000:1.0:1788330476.645438:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330476.645449:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+11:22666:x1875199792496512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330476.645471:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330476.645488:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd292a expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330476.645515:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd292a expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330476.645526:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd292a expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330476.645535:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064200, rc 0) 00000100:00100000:1.0:1788330476.645590:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22666:x1875199792496512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330476.645597:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788330476.645699:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792496512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330476.645726:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330476.645746:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330476.645803:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792496640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788330476.645836:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330476.645860:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec98de000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330476.645926:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792496640 00000100:00100000:0.0:1788330476.645930:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792496640 00000100:00100000:0.0:1788330476.646093:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330476.646104:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22666:x1875199792496640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330476.646117:0:22664:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330476.646132:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330476.646135:0:22664:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788330476.646530:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:22666:x1875199792496640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 284us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330476.650364:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792496640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788330476.650454:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330476.650467:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330476.650479:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330476.655109:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788330477.020767:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330477.404808:0:22703:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788330477.404818:0:22703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330477.404970:0:22703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788330477.405013:0:22703:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330477.405201:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788330477.469951:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:3.0:1788330478.048852:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330478.491279:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:2.0:1788330479.067318:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330479.528401:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000001:02000400:2.0:1788330479.779857:0:22951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788330480.095509:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330480.539276:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000100:00080000:2.0:1788330480.539563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788330480.539567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788330480.539571:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330480.539577:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 679 00000100:00080000:2.0:1788330480.539581:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330480.539587:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc67e9800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330480.539604:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fe300 x1875199792496896/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330480.539618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330480.539621:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330480.539624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330480.539627:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330480.539629:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788330480.539655:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788330480.539657:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc7d07800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330480.539662:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99edc7d07800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330480.539663:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792496896:0@lo:38:kworker.0 00000100:00100000:2.0:1788330480.539677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fd500 x1875199792497024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330480.539881:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330480.539891:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792496768:0@lo:400:kworker.0 00000100:00100000:1.0:1788330480.539951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330480.540015:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792497024:0@lo:38:kworker.0 00000100:00100000:1.0:1788330480.540043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330480.540206:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792496896 00000100:00100000:2.0:1788330480.540216:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792496896 00000100:00100000:2.0:1788330480.540258:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330480.540267:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792496896:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788330480.540274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:2.0:1788330480.540286:0:22674:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788330480.540319:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792497024 00000100:00100000:2.0:1788330480.540329:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792496896:12345-0@lo:38:kworker.0 Request processed in 61us (378us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788330480.540334:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792497024 00000100:00100000:2.0:1788330480.540336:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330480.540355:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330480.540360:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792497024:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788330480.540375:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1788330480.540412:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8475908e9fd2938 00000004:00100000:3.0:1788330480.540428:0:22670:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788330480.540455:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330480.540465:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330480.540468:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792496896:0@lo:38:kworker.0 00000100:00080000:3.0:1788330480.540582:0:22670:0:(import.c:65:import_set_state_nolock()) ffff99edc759d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330480.540625:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875199792497024:12345-0@lo:38:kworker.0 Request processed in 264us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330480.540632:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788330480.541215:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99edc72fd500 x1875199792497024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330480.541236:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788330480.541261:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788330480.541276:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788330480.541279:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7d07800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788330480.541286:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792497024:0@lo:38:kworker.0 00000100:00100000:2.0:1788330480.543538:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792496768 00000100:00100000:2.0:1788330480.543555:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792496768 00000100:00100000:2.0:1788330480.546020:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330480.546041:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:3646:x1875199792496768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330480.546210:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:3646:x1875199792496768:12345-0@lo:400:kworker.0 Request processed in 178us (5934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330480.546218:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330480.546253:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792496768:0@lo:400:kworker.0 00000020:00000004:2.0:1788330480.793216:0:23003:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330480.793409:0:23003:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330481.115302:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330481.563665:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000020:00000004:3.0:1788330481.764507:0:23055:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330481.764697:0:23055:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330482.140676:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330482.587280:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:3.0:1788330483.163355:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330483.611329:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:2.0:1788330484.193411:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330484.637745:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:2.0:1788330485.212477:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330485.665370:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000100:00080000:3.0:1788330485.665770:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788330485.665775:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788330485.665779:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330485.665786:0:23217:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 684 00000100:00080000:3.0:1788330485.665792:0:23217:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788330485.665800:0:23217:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc67e9800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330485.665821:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eec995df80 x1875199792497280/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330485.665833:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330485.665836:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330485.665839:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330485.665842:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788330485.665897:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792497408:0@lo:400:kworker.0 00000100:00100000:3.0:1788330485.665968:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330485.666020:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330485.666026:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792497152:0@lo:400:kworker.0 00000100:00100000:3.0:1788330485.666055:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330485.666109:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792497408 00000100:00100000:3.0:1788330485.666118:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792497408 00000100:00100000:3.0:1788330485.666220:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330485.666231:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792497408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330485.666283:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792497408:12345-0@lo:400:kworker.0 Request processed in 54us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330485.666290:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788330485.666330:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99eec995c380 x1875199792497408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330485.666345:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792497408:0@lo:400:kworker.0 00000100:00100000:0.0:1788330485.667771:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792497152 00000100:00100000:0.0:1788330485.667783:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792497152 00000100:00100000:0.0:1788330485.667826:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788330485.667835:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:3649:x1875199792497152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330485.667908:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:3649:x1875199792497152:12345-0@lo:400:kworker.0 Request processed in 74us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330485.667915:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788330485.667964:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792497152:0@lo:400:kworker.0 00000100:00100000:0.0:1788330485.668935:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330475/real 1788330475] req@ffff99eec995d180 x1875199792493952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330485 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330485.668959:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eec995d180 x1875199792493952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330485 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330485.668970:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330475/real 1788330475] req@ffff99edc72ff480 x1875199792493824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330485 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330485.668982:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc72ff480 x1875199792493824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330485 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330485.669001:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792497280:0@lo:38:kworker.0 00000100:00100000:0.0:1788330485.669053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330485.669092:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330485.669107:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788330485.669111:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792493952:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788330485.669115:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eef59c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330485.669129:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788330485.669132:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792493824:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788330485.669292:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792497280 00000100:00100000:3.0:1788330485.669299:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792497280 00000100:00100000:3.0:1788330485.669337:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330485.669346:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792497280:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788330485.669366:0:22674:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788330485.669839:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792497280:12345-0@lo:38:kworker.0 Request processed in 492us (783us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788330485.669847:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788330485.669872:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330485.669876:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788330485.669879:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99eef59c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330485.669883:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 679 00000100:00080000:3.0:1788330485.669887:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788330485.669892:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99eef59c0000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330485.669917:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eec995c380 x1875199792497536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330485.669943:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330485.669946:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788330485.669947:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330485.669951:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 679 00000100:00080000:3.0:1788330485.669953:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788330485.669956:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99edc7d06800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330485.669967:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eec995ed80 x1875199792497664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330485.673507:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330485.673520:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330485.673525:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792497280:0@lo:38:kworker.0 00000100:00100000:1.0:1788330485.673559:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792497536:0@lo:8:kworker.0 00000400:00000100:1.0:1788330485.673783:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792497536 offset 0 length 520: 4 00000100:00100000:1.0:1788330485.673824:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792497664:0@lo:8:kworker.0 00000400:00000100:1.0:1788330485.673840:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792497664 offset 0 length 520: 4 00010000:00010000:2.0:1788330486.236398:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330486.685258:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:2.0:1788330487.282479:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330487.644319:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788330487.707375:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:2.0:1788330488.283840:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330488.737483:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:2.0:1788330489.309788:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788330489.365512:0:23401:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788330489.365516:0:23401:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788330489.365518:0:23401:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788330489.365649:0:23401:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99edc7d04000 00000020:01000004:2.0:1788330489.365668:0:23401:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788330489.365680:0:23401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788330489.365695:0:23401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff99edc67dcd28) 00000020:00000080:2.0:1788330489.365712:0:23401:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788330489.490845:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788330489.492398:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.501306:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.501650:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.502471:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.502867:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.503146:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.503567:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.504754:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.505511:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.505781:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.505955:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.506134:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.506545:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.506780:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.506953:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.507131:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.507498:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.507729:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.507924:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.508103:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.508494:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.508890:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.509087:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.509372:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.509712:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.509908:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.510083:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.510533:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.510807:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.511037:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.511329:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788330489.511571:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.511788:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788330489.512749:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788330489.513173:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788330489.513534:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788330489.513943:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788330489.514176:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788330489.514534:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788330489.515461:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788330489.515746:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788330489.516003:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788330489.516303:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788330489.516630:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788330489.516889:0:23401:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788330489.517813:0:23401:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788330489.518049:0:23401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788330489.518062:0:23401:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788330489.518075:0:23401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd2946 00000020:01000004:2.0:1788330489.518082:0:23401:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788330489.518105:0:23401:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788330489.518109:0:23401:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788330489.518115:0:23401:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788330489.518145:0:23401:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788330489.518743:0:23401:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788330489.526027:0:23401:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788330489.526081:0:23401:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.150@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788330489.526086:0:23401:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788330489.526088:0:23401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788330489.526090:0:23401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330489.526091:0:23401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330489.526092:0:23401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330489.526093:0:23401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330489.526095:0:23401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788330489.526097:0:23401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330489.526099:0:23401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330489.526104:0:23401:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788330489.526106:0:23401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788330489.526108:0:23401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788330489.526109:0:23401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330489.526110:0:23401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330489.526111:0:23401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330489.526112:0:23401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330489.526114:0:23401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788330489.526115:0:23401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330489.526116:0:23401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330489.526250:0:23401:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788330489.526275:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792497792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788330489.526373:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.526560:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581480 going to sleep for 11 seconds 00000100:00100000:1.0:1788330489.528612:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792497792 00000100:00100000:1.0:1788330489.528631:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792497792 00000100:00100000:1.0:1788330489.528707:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330489.528848:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:23401:x1875199792497792:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788330489.528890:0:22663:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788330489.528894:0:22663:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788330489.528918:0:22663:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788330489.529817:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:23401:x1875199792497792:12345-0@lo:253:mount.lustre.0 Request processed in 970us (3440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330489.529827:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788330489.530874:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792497792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330489.530892:0:23401:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788330489.530896:0:23401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330489.530898:0:23401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788330489.530899:0:23401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330489.530900:0:23401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330489.530902:0:23401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330489.530903:0:23401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330489.530905:0:23401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788330489.530906:0:23401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330489.530908:0:23401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788330489.530932:0:23401:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99edc7d04000 from lustre-MDT0001 10000000:01000000:3.0:1788330489.530971:0:23401:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788330489.530974:0:23401:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788330489.530981:0:23401:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99eec8bb4d28 local copy 00010000:00010000:3.0:1788330489.530992:0:23401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330489.531103:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792497920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330489.531181:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.531228:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.531344:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792497920 00000100:00100000:2.0:1788330489.531351:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792497920 00000100:00100000:2.0:1788330489.531399:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330489.531410:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:23401:x1875199792497920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330489.531506:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:23401:x1875199792497920:12345-0@lo:501:mount.lustre.0 Request processed in 98us (324us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788330489.531513:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788330489.531564:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792497920:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788330489.531579:0:23401:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788330489.531610:0:23401:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788330489.531616:0:23401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.531625:0:23401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330489.531669:0:23401:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99edc7d04000 10000000:01000000:3.0:1788330489.531674:0:23401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788330489.531679:0:23401:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99eec8bb4d28 10000000:01000000:3.0:1788330489.531682:0:23401:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788330489.531685:0:23401:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99eec8bb4d28 from 1 10000000:01000000:3.0:1788330489.531703:0:23401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788330489.531738:0:23401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd294d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.531747:0:23401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd294d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.531756:0:23401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd294d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330489.531770:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330489.531797:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.531822:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330489.531944:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792498048 00000100:00100000:1.0:1788330489.531949:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792498048 00000100:00100000:1.0:1788330489.531984:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330489.531992:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+12:23401:x1875199792498048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330489.532001:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330489.532015:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02065c00/0x8475908e9fd2954 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd294d expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.532036:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02065c00/0x8475908e9fd2954 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd294d expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.532047:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02065c00/0x8475908e9fd2954 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd294d expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.532056:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02065c00, rc 0) 00000100:00100000:1.0:1788330489.532093:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+13:23401:x1875199792498048:12345-0@lo:101:mount.lustre.0 Request processed in 102us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330489.532099:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330489.532295:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330489.532308:0:23401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd294d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2954 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.532317:0:23401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd294d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2954 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330489.532334:0:23401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788330489.532350:0:23401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd294d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2954 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.532380:0:23401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd294d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2954 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330489.532389:0:23401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99edc7d04000 10000000:01000000:3.0:1788330489.532393:0:23401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788330489.532396:0:23401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99edc7d04000 from 1 10000000:01000000:3.0:1788330489.532472:0:23401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788330489.532492:0:23401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd295b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.532499:0:23401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd295b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.532507:0:23401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd295b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330489.532519:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330489.532561:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.532591:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.533404:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792498176 00000100:00100000:2.0:1788330489.533413:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792498176 00000100:00100000:2.0:1788330489.533467:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788330489.533477:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+13:23401:x1875199792498176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330489.533490:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330489.533504:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9039000/0x8475908e9fd2962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd295b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.533526:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039000/0x8475908e9fd2962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd295b expref: 14 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.533562:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9039000/0x8475908e9fd2962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd295b expref: 14 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.533571:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039000, rc 0) 00000100:00100000:2.0:1788330489.533635:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+14:23401:x1875199792498176:12345-0@lo:101:mount.lustre.0 Request processed in 160us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.533641:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330489.533673:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330489.533856:0:23401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd295b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2962 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.533868:0:23401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd295b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2962 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330489.533886:0:23401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788330489.533941:0:23401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd295b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2962 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.533955:0:23401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd295b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2962 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330489.533963:0:23401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788330489.533968:0:23401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788330489.533975:0:23401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99edc7d04000 10000000:01000000:3.0:1788330489.533978:0:23401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788330489.533982:0:23401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788330489.533985:0:23401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788330489.534009:0:23401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd2969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.534017:0:23401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd2969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.534026:0:23401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd2969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330489.534046:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330489.534080:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.534116:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581900 going to sleep for 11 seconds 00000100:00100000:0.0:1788330489.534182:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792498304 00000100:00100000:0.0:1788330489.534188:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792498304 00000100:00100000:0.0:1788330489.534231:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788330489.534239:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+14:23401:x1875199792498304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330489.534247:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330489.534258:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78c00/0x8475908e9fd2970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2969 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330489.534274:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78c00/0x8475908e9fd2970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2969 expref: 15 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330489.534283:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78c00/0x8475908e9fd2970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2969 expref: 15 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330489.534290:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78c00, rc 0) 00000100:00100000:0.0:1788330489.534326:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498304:12345-0@lo:101:mount.lustre.0 Request processed in 88us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.534332:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330489.534444:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330489.534456:0:23401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd2969 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2970 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.534464:0:23401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd2969 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2970 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330489.537989:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788330489.538841:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330489.547894:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788330489.547949:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788330489.547961:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788330489.547976:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788330489.547994:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788330489.548005:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788330489.548016:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788330489.548027:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788330489.548038:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788330489.548052:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788330489.548064:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788330489.548074:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788330489.548085:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788330489.548095:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788330489.548106:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788330489.548117:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788330489.548127:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788330489.548139:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788330489.548171:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788330489.548186:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788330489.548197:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788330489.548208:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788330489.548218:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788330489.548229:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788330489.548240:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788330489.548250:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788330489.548261:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788330489.548271:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788330489.548281:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788330489.548301:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788330489.548311:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788330489.548322:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788330489.548333:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788330489.548344:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788330489.548354:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788330489.548366:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788330489.548376:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788330489.548387:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788330489.548397:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788330489.548866:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788330489.548878:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788330489.548889:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788330489.548903:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788330489.548914:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788330489.548940:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788330489.548946:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788330489.549059:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330489.549125:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.549236:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca5813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.549830:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792498432 00000100:00100000:2.0:1788330489.549840:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792498432 00000100:00100000:2.0:1788330489.549958:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788330489.549970:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330489.550205:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498432:12345-0@lo:501:mount.lustre.0 Request processed in 237us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.550213:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330489.550331:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330489.550381:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330489.550439:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.550727:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca5813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330489.551002:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792498560 00000100:00100000:0.0:1788330489.551008:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792498560 00000100:00100000:0.0:1788330489.551037:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788330489.551046:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330489.554123:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498560:12345-0@lo:503:mount.lustre.0 Request processed in 3067us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.554176:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330489.554310:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498560:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788330489.555570:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788330489.555816:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330489.555894:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.556001:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581900 going to sleep for 11 seconds 00000100:00100000:0.0:1788330489.556047:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792498688 00000100:00100000:0.0:1788330489.556055:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792498688 00000100:00100000:0.0:1788330489.556134:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330489.556145:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330489.557101:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498688:12345-0@lo:502:mount.lustre.0 Request processed in 954us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.557111:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788330489.557254:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330489.559305:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788330489.559362:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788330489.559378:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788330489.559390:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1788330489.560020:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1788330489.560050:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1788330489.560067:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1788330489.560080:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1788330489.560095:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1788330489.560109:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1788330489.560123:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1788330489.560135:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1788330489.560207:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1788330489.560226:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1788330489.560239:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1788330489.560253:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1788330489.560266:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1788330489.560280:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1788330489.560291:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1788330489.560303:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1788330489.560314:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1788330489.560325:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1788330489.560337:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1788330489.560368:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1788330489.560387:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1788330489.560543:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1788330489.560573:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1788330489.560597:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1788330489.560612:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1788330489.560624:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1788330489.560638:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1788330489.560649:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1788330489.560662:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1788330489.560674:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1788330489.560684:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1788330489.560697:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1788330489.560708:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1788330489.560867:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1788330489.560886:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1788330489.560901:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1788330489.560914:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1788330489.560927:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1788330489.560939:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1788330489.560951:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1788330489.561005:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330489.561116:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.561251:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec98de480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330489.562575:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792498816 00000100:00100000:0.0:1788330489.562660:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792498816 00000100:00100000:0.0:1788330489.562862:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788330489.562874:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330489.563046:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792498816:12345-0@lo:502:mount.lustre.0 Request processed in 174us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.563053:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788330489.563190:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792498816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330489.563272:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788330489.563286:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788330489.564487:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330489.564502:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330489.564505:0:23405:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788330489.564510:0:23405:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788330489.564513:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330489.564529:0:23405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff99eefd333370) 00000020:00000080:1.0:1788330489.564558:0:23405:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788330489.564564:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788330489.569994:0:23405:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788330489.570017:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd297e 00000020:00000080:1.0:1788330489.573352:0:23405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788330489.573381:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330489.573394:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330489.573396:0:23405:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788330489.573407:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330489.573413:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330489.573414:0:23405:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788330489.573419:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330489.573440:0:23405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff99eefd334d28) 00000020:00000080:1.0:1788330489.573470:0:23405:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788330489.573478:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788330489.573480:0:23405:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788330489.573484:0:23405:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788330489.573491:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788330489.574218:0:23405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7d04000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788330489.574240:0:23405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff99eefd3319b8) 00000020:00000080:1.0:1788330489.574260:0:23405:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788330489.574341:0:23405:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788330489.574349:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd2993 00000020:00000080:1.0:1788330489.576670:0:23405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788330489.576683:0:23405:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788330489.576704:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x8475908e9fd299a 00080000:01000000:1.0:1788330489.576916:0:23405:0:(osd_handler.c:8927:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788330489.576924:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd29a1 00010000:00010000:3.0:1788330489.696778:0:23405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788330489.698136:0:23405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788330489.698935:0:23405:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788330489.700434:0:23405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788330489.700453:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330489.700461:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330489.700463:0:23405:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788330489.700466:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330489.700473:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330489.700474:0:23405:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788330489.700477:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788330489.700483:0:23405:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:00000080:1.0:1788330489.700513:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330489.700531:0:23405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff99eeffc4b370) 00000020:00000080:1.0:1788330489.700747:0:23405:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788330489.700756:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788330489.700869:0:23405:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788330489.700878:0:23405:0:(osd_handler.c:8927:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788330489.700886:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd29af 00010000:00080000:1.0:1788330489.700923:0:23405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eef6de1800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330489.707830:0:23405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788330489.714512:0:23405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788330489.714530:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788330489.718687:0:23405:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788330489.718916:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd29b6 00000100:00080000:2.0:1788330489.718930:0:23405:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330489.718937:0:23405:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99eef6de1800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330489.718978:0:23405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fc700 x1875199792498944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330489.719001:0:23405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788330489.719034:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792498944:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788330489.719093:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788330489.719099:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788330489.719103:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330489.719107:0:23217:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 689 00000100:00080000:0.0:1788330489.719111:0:23217:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1788330489.719114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330489.719115:0:23217:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc67e9800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330489.719131:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffc99180 x1875199792499072/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330489.719140:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330489.719143:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330489.719176:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330489.719179:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788330489.719186:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792499072:0@lo:38:kworker.0 00000100:00100000:1.0:1788330489.719209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330489.719228:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792499200:0@lo:400:kworker.0 00000100:00100000:0.0:1788330489.719265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.719292:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792498944 00000100:00100000:0.0:1788330489.719302:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792499200 00000100:00100000:1.0:1788330489.719307:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792498944 00000100:00100000:0.0:1788330489.719307:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792499200 00000100:00100000:1.0:1788330489.719335:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792499072 00000100:00100000:1.0:1788330489.719337:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792499072 00000100:00100000:0.0:1788330489.719343:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330489.719347:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330489.719351:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792498944:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788330489.719352:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792499200:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788330489.719439:0:22674:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1788330489.719492:0:22674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd29bd 00000004:00100000:1.0:1788330489.719507:0:22674:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788330489.719514:0:22674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:2.0:1788330489.719979:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.719993:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.719995:0:23405:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788330489.720001:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330489.720004:0:23405:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788330489.720005:0:23405:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330489.720007:0:23405:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330489.720008:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330489.720011:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.720013:0:23405:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330489.720016:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330489.720021:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.720022:0:23405:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788330489.720026:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788330489.720129:0:23405:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788330489.720174:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.720178:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.720179:0:23405:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788330489.720182:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330489.720184:0:23405:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788330489.720185:0:23405:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330489.720186:0:23405:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330489.720188:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330489.720191:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.720192:0:23405:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330489.720194:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330489.720197:0:23405:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788330489.720200:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.720201:0:23405:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788330489.720203:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788330489.720207:0:23405:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:2.0:1788330489.720228:0:23405:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788330489.720231:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330489.720247:0:23405:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99edc67d99b8) 00000020:00000080:2.0:1788330489.720263:0:23405:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788330489.720276:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788330489.720341:0:23405:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788330489.720348:0:23405:0:(osd_handler.c:8927:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788330489.720482:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd29cb 00010000:00080000:2.0:1788330489.720515:0:23405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc5f30800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330489.720841:0:23405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788330489.721339:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792499200:12345-0@lo:400:kworker.0 Request processed in 1985us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.721348:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788330489.721427:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99eeffc99880 x1875199792499200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330489.721443:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792499200:0@lo:400:kworker.0 00000040:01000000:2.0:1788330489.722354:0:23405:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788330489.723117:0:23405:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788330489.724760:0:23405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330489.724917:0:23405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788330489.725085:0:23405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788330489.725521:0:23410:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788330489.725526:0:23410:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788330489.727828:0:23405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330489.727848:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788330489.727903:0:23405:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788330489.727930:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd29d2 00000100:00080000:2.0:1788330489.727943:0:23405:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330489.727949:0:23405:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99edc5f30800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330489.727996:0:23405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fd180 x1875199792499328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330489.728087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792499328:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788330489.728180:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792499328 offset 0 length 520: 4 00000100:00080000:2.0:1788330489.728375:0:23405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788330489.728493:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.728498:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.728500:0:23405:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788330489.728503:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330489.728506:0:23405:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788330489.728508:0:23405:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330489.728509:0:23405:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330489.728511:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330489.728513:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.728515:0:23405:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330489.728517:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330489.728522:0:23405:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788330489.728531:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.728533:0:23405:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788330489.728536:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788330489.728539:0:23405:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:2.0:1788330489.728574:0:23405:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788330489.728577:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330489.728599:0:23405:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99edc67db370) 00000020:00000080:2.0:1788330489.728614:0:23405:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788330489.728619:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788330489.728695:0:23405:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788330489.728702:0:23405:0:(osd_handler.c:8927:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788330489.728708:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd29e0 00010000:00080000:2.0:1788330489.728746:0:23405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eeffa6f000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330489.728968:0:23405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788330489.729058:0:23405:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788330489.729074:0:23405:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788330489.731929:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330489.731938:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330489.731941:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330489.731944:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788330489.732390:0:23405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330489.733447:0:23405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788330489.733625:0:23405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1788330489.734260:0:23412:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788330489.734267:0:23412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788330489.735264:0:23405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330489.735279:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788330489.735318:0:23405:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788330489.735342:0:23405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd29e7 00000100:00080000:2.0:1788330489.735353:0:23405:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330489.735360:0:23405:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99eeffa6f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330489.735406:0:23405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fc380 x1875199792499456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330489.735493:0:23405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788330489.735602:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.735607:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.735614:0:23405:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788330489.735619:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330489.735623:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.735624:0:23405:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788330489.735627:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788330489.735629:0:23405:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788330489.735631:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.735633:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.735634:0:23405:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788330489.735636:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330489.735638:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.735639:0:23405:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788330489.735642:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788330489.735672:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.735675:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.735676:0:23405:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788330489.735679:0:23405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:1.0:1788330489.735928:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792499456:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788330489.735990:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792499456 offset 0 length 520: 4 00000020:01000000:1.0:1788330489.736073:0:23401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788330489.736121:0:23401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788330489.736147:0:23401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd2969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2970 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.736192:0:23401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd2969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2970 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330489.736214:0:23401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d04000 from 1 10000000:01000000:1.0:1788330489.736217:0:23401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788330489.736248:0:23401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.736255:0:23401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.736267:0:23401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330489.736283:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792499584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330489.736320:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.736340:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788330489.736363:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792499584 00000100:00100000:1.0:1788330489.736370:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792499584 00000100:00100000:1.0:1788330489.736415:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788330489.736438:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+15:23401:x1875199792499584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330489.736449:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330489.736462:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd29ee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.736485:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd29ee expref: 16 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.736494:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd29ee expref: 16 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.736513:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064000, rc 0) 00000100:00100000:1.0:1788330489.736567:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+16:23401:x1875199792499584:12345-0@lo:101:mount.lustre.0 Request processed in 130us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330489.736574:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788330489.736799:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792499584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330489.736815:0:23401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.736824:0:23401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788330489.737774:0:22674:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330489.737846:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792498944:12345-0@lo:38:llog_process_th.0 Request processed in 18493us (18731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.737857:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330489.737901:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330489.737910:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788330489.737918:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788330489.737924:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788330489.737927:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eef6de1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788330489.737940:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792498944:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330489.737969:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330489.737975:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792499072:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788330489.738024:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792499072:12345-0@lo:38:kworker.0 Request processed in 48us (18814us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788330489.738108:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330489.738137:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330489.738142:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330489.738146:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788330489.738167:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792499072:0@lo:38:kworker.0 00000100:00100000:2.0:1788330489.738225:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330489.738237:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792499712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330489.738270:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330489.738303:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792499712 00000100:00100000:2.0:1788330489.738310:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792499712 00000100:00100000:2.0:1788330489.738391:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330489.738398:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792499712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330489.738490:0:22673:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788330489.738533:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792499712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.738540:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330489.738833:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792499840:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788330489.738872:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.738897:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.739013:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792499712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330489.739142:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792499840 00000100:00100000:3.0:1788330489.739147:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792499840 00000100:00100000:3.0:1788330489.739218:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330489.739225:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+16:23401:x1875199792499840:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788330489.739241:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788330489.739259:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788330489.739263:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788330489.739348:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+16:23401:x1875199792499840:12345-0@lo:256:mount.lustre.0 Request processed in 123us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.739355:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788330489.739559:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792499840:0@lo:256:mount.lustre.0 00000100:00080000:0.0:1788330489.739743:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330489.739748:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330489.739751:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330489.739753:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 10000000:01000000:1.0:1788330489.740775:0:23401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330489.740838:0:23401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.740852:0:23401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330489.740860:0:23401:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7d04000 from 1 10000000:01000000:1.0:1788330489.740862:0:23401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330489.740899:0:23401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.740919:0:23401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.740930:0:23401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330489.740952:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792499968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330489.741007:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.741057:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330489.741180:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792499968 00000100:00100000:3.0:1788330489.741187:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792499968 00000100:00100000:3.0:1788330489.741230:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788330489.741239:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+16:23401:x1875199792499968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330489.741250:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330489.741263:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd29fc expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.741286:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd29fc expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.741296:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd29fc expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.741313:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b600, rc 0) 00000100:00100000:3.0:1788330489.741364:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792499968:12345-0@lo:101:mount.lustre.0 Request processed in 126us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.741371:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788330489.741581:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792499968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330489.741671:0:23401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330489.741679:0:23401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330489.742994:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1788330489.743580:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330489.743860:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788330489.743896:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788330489.743910:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788330489.743921:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788330489.743933:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788330489.743945:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788330489.743956:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1788330489.743969:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1788330489.743982:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788330489.743993:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1788330489.744005:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1788330489.744022:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1788330489.744098:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1788330489.744329:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330489.744394:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.744563:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330489.744800:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792500096 00000100:00100000:0.0:1788330489.744808:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792500096 00000100:00100000:0.0:1788330489.744908:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788330489.744920:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330489.745054:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500096:12345-0@lo:501:mount.lustre.0 Request processed in 136us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.745062:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788330489.745135:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330489.745215:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330489.745255:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.745453:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788330489.745576:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792500224 00000100:00100000:3.0:1788330489.745582:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792500224 00000100:00100000:3.0:1788330489.745669:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788330489.745676:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500224:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330489.745804:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500224:12345-0@lo:503:mount.lustre.0 Request processed in 127us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.745811:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788330489.745923:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500224:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788330489.746520:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330489.746678:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330489.746728:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.746812:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.746870:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792500352 00000100:00100000:2.0:1788330489.746875:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792500352 00000100:00100000:3.0:1788330489.746926:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330489.746934:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330489.747108:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330489.747314:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788330489.747342:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788330489.747371:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788330489.747387:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788330489.747400:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1788330489.747412:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1788330489.751009:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1788330489.751102:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1788330489.751119:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788330489.751132:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1788330489.751145:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1788330489.751218:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330489.751310:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.751359:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788330489.751523:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500352:12345-0@lo:502:mount.lustre.0 Request processed in 4587us (4791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.751537:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330489.751606:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792500480 00000100:00100000:3.0:1788330489.751616:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792500480 00000100:00100000:3.0:1788330489.751650:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330489.751659:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330489.751777:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500480:12345-0@lo:502:mount.lustre.0 Request processed in 119us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.751784:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330489.751849:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788330489.751912:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1788330489.751921:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788330489.752995:0:23414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330489.753008:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330489.753010:0:23414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788330489.753017:0:23414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99edc7d04000 00000020:00000080:3.0:1788330489.753019:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330489.753090:0:23414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330489.753095:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330489.753097:0:23414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788330489.753100:0:23414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330489.753102:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330489.753103:0:23414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788330489.753106:0:23414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99edc7d04000 00000020:00000080:3.0:1788330489.753109:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330489.753525:0:23414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.753653:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.753656:0:23414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788330489.753661:0:23414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330489.753665:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.753666:0:23414:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788330489.753670:0:23414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99edc7d04000 00000020:00000080:2.0:1788330489.753672:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788330489.753704:0:23414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.753722:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.753724:0:23414:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788330489.753727:0:23414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330489.753729:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.753731:0:23414:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788330489.753734:0:23414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99edc7d04000 00000020:00000080:2.0:1788330489.753736:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788330489.753767:0:23414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330489.753771:0:23414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330489.753773:0:23414:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788330489.753776:0:23414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788330489.754099:0:23401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788330489.754130:0:23401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330489.754180:0:23401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.754205:0:23401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330489.754260:0:23401:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788330489.754263:0:23401:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99edc7d04000 10000000:01000000:1.0:1788330489.754267:0:23401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99edc7d04000 10000000:01000000:1.0:1788330489.754271:0:23401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788330489.754278:0:23401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99edc7d04000 from 1 10000000:01000000:1.0:1788330489.754280:0:23401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788330489.754331:0:23401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02064c00/0x8475908e9fd2a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.754340:0:23401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02064c00/0x8475908e9fd2a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.754351:0:23401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02064c00/0x8475908e9fd2a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330489.754377:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330489.755288:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.755374:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330489.757570:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000100:00100000:3.0:1788330489.771231:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792500608 00000100:00100000:3.0:1788330489.771247:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792500608 00000100:00100000:3.0:1788330489.771311:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330489.771324:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:23401:x1875199792500608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330489.771345:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330489.771365:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147a400/0x8475908e9fd2a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2a0a expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.771394:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147a400/0x8475908e9fd2a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2a0a expref: 18 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.771406:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147a400/0x8475908e9fd2a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a0a expref: 18 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.771428:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147a400, rc 0) 00000100:00100000:3.0:1788330489.771520:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792500608:12345-0@lo:101:mount.lustre.0 Request processed in 198us (16233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.771528:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330489.771631:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330489.771651:0:23401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02064c00/0x8475908e9fd2a0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a11 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.771661:0:23401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02064c00/0x8475908e9fd2a0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2a11 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330489.781271:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788330489.781736:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330489.781927:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788330489.781955:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788330489.781971:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788330489.781985:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788330489.781999:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788330489.782014:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788330489.782026:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788330489.782037:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788330489.782050:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788330489.782081:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788330489.782096:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788330489.782109:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788330489.782120:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788330489.782133:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788330489.782146:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788330489.782199:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788330489.782212:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788330489.782227:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788330489.782241:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788330489.782254:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788330489.782280:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788330489.782293:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788330489.782306:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788330489.782319:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788330489.782330:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788330489.782355:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788330489.782372:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788330489.782386:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788330489.782399:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788330489.782413:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788330489.786329:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788330489.786358:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788330489.786372:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788330489.786386:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788330489.786398:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788330489.786410:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788330489.786492:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788330489.786507:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788330489.786521:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788330489.786534:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788330489.786555:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788330489.787532:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788330489.787576:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788330489.787668:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788330489.787684:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788330489.787698:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788330489.787713:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788330489.787727:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788330489.787914:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788330489.787934:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788330489.787953:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788330489.787958:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788330489.788075:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330489.788176:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330489.788223:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330489.789671:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792500736 00000100:00100000:0.0:1788330489.789681:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792500736 00000100:00100000:0.0:1788330489.789737:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788330489.789749:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792500736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330489.789918:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792500736:12345-0@lo:501:mount.lustre.0 Request processed in 169us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.789926:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788330489.790049:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330489.790093:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330489.790140:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330489.790334:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792500864 00000100:00100000:2.0:1788330489.790339:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792500864 00000100:00100000:2.0:1788330489.790406:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788330489.790414:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792500864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330489.791760:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792500864:12345-0@lo:503:mount.lustre.0 Request processed in 1344us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.791770:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788330489.791902:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.791924:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500864:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788330489.792830:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330489.792921:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330489.792980:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330489.793801:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330489.797832:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792500992 00000100:00100000:0.0:1788330489.797849:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792500992 00000100:00100000:0.0:1788330489.797919:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330489.797931:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792500992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330489.798113:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792500992:12345-0@lo:502:mount.lustre.0 Request processed in 183us (5131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.798121:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330489.798237:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792500992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330489.798667:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788330489.798701:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788330489.798717:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788330489.798731:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788330489.798743:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788330489.798756:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788330489.798768:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788330489.798780:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788330489.798792:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788330489.798804:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788330489.798816:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788330489.798828:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788330489.798841:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788330489.798853:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788330489.798865:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788330489.798878:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788330489.798890:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788330489.798905:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788330489.798920:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788330489.798932:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788330489.798944:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788330489.798955:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788330489.798966:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788330489.798979:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788330489.798993:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788330489.799006:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788330489.799020:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788330489.799034:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788330489.799047:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788330489.799061:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788330489.799075:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788330489.799102:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788330489.799117:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788330489.799129:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788330489.799143:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788330489.799187:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788330489.799204:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788330489.799217:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788330489.799229:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788330489.799243:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788330489.799273:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788330489.799288:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788330489.799302:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788330489.799315:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788330489.799328:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788330489.799340:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788330489.799351:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788330489.799364:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788330489.799413:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792501120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330489.801756:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330489.801802:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792501120 00000100:00100000:0.0:1788330489.801810:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792501120 00000100:00100000:0.0:1788330489.802700:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788330489.802716:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792501120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330489.802863:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792501120:12345-0@lo:502:mount.lustre.0 Request processed in 152us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330489.802872:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788330489.806341:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.806389:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792501120:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330489.806780:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788330489.806812:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788330489.806853:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792501248:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330489.806927:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330489.806977:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330489.807039:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792501248 00000100:00100000:3.0:1788330489.807047:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792501248 00000100:00100000:3.0:1788330489.807105:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330489.807115:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792501248:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330489.807266:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792501248:12345-0@lo:502:mount.lustre.0 Request processed in 152us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.807275:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788330489.807392:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792501248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330489.807534:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788330489.807543:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788330489.808775:0:23420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788330489.808803:0:23420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff99eeffb619b8) 00000020:00000080:2.0:1788330489.808827:0:23420:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788330489.809038:0:23420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7d04000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788330489.809042:0:23420:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7d04000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788330489.809045:0:23420:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7d04000 3 00010000:00080000:2.0:1788330489.809078:0:23420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc7e26800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330489.812018:0:23420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788330489.812271:0:23420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788330489.812316:0:23420:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788330489.812331:0:23420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x8475908e9fd2a1f 00000100:00080000:2.0:1788330489.812341:0:23420:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330489.812347:0:23420:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99edc7e26800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330489.812385:0:23420:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72ff800 x1875199792501376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330489.812681:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792501376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330489.812815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788330489.812884:0:23420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788330489.813362:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330489.813367:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330489.813370:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330489.813379:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788330489.814701:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792501376 00000100:00100000:2.0:1788330489.815303:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792501376 00000100:00100000:2.0:1788330489.815356:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330489.815368:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792501376:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788330489.815400:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1788330489.815537:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x8475908e9fd2a26 00000004:00100000:2.0:1788330489.815567:0:22670:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788330489.815676:0:22670:0:(import.c:65:import_set_state_nolock()) ffff99eef6de0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330489.816131:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875199792501376:12345-0@lo:38:llog_process_th.0 Request processed in 763us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.816140:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788330489.816266:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99edc72ff800 x1875199792501376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330489.816278:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330489.816286:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788330489.816295:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788330489.816300:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788330489.816303:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e26800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788330489.816309:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792501376:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788330489.816947:0:23420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788330489.817094:0:23401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788330489.817129:0:23401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788330489.817179:0:23401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02064c00/0x8475908e9fd2a0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a11 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330489.817190:0:23401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02064c00/0x8475908e9fd2a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a11 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788330489.817253:0:23401:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788330489.817256:0:23401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788330489.817257:0:23401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330489.817258:0:23401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330489.817259:0:23401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330489.817261:0:23401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330489.817262:0:23401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330489.817264:0:23401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330489.817266:0:23401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330489.817271:0:23401:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788330489.817273:0:23401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788330489.817275:0:23401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788330489.817275:0:23401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330489.817277:0:23401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330489.817278:0:23401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330489.817279:0:23401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330489.817280:0:23401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330489.817281:0:23401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330489.817282:0:23401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330489.817304:0:23401:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788330489.817320:0:23401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792501504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788330489.817374:0:23401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330489.817410:0:23401:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.820117:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792501504 00000100:00100000:2.0:1788330489.820134:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792501504 00000100:00100000:2.0:1788330489.820224:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788330489.820236:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792501504:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788330489.820271:0:22663:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788330489.820285:0:22663:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788330489.822468:0:22649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788330489.823029:0:22663:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788330489.823048:0:22663:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788330489.823516:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:23401:x1875199792501504:12345-0@lo:253:mount.lustre.0 Request processed in 3277us (6136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.823529:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788330489.823655:0:23401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:23401:1875199792501504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788330489.823670:0:23401:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788330489.823674:0:23401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788330489.823676:0:23401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788330489.823677:0:23401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330489.823678:0:23401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330489.823679:0:23401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330489.823680:0:23401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330489.823681:0:23401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330489.823683:0:23401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330489.823694:0:23401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788330489.823708:0:23401:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788330489.824691:0:22684:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788330489.824704:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788330489.824725:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.824743:0:22684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd292a expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.824751:0:22684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd29ee expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.824759:0:22684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.824797:0:22684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd29ee expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.824812:0:22684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd29ee expref: 17 pid: 22662 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330489.824825:0:22684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792501632:0@lo:104: 00000100:00100000:3.0:1788330489.824878:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330489.824936:0:22684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd292a expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.824944:0:22684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd292a expref: 17 pid: 22663 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330489.824952:0:22684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792501760:0@lo:104: 00000100:00100000:3.0:1788330489.824972:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.824988:0:22684:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581900 going to sleep for 11 seconds 00000100:00100000:3.0:1788330489.825023:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792501632 00000100:00100000:3.0:1788330489.825036:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792501632 00000100:00100000:3.0:1788330489.825068:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792501760 00000100:00100000:3.0:1788330489.825071:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792501760 00000100:00100000:3.0:1788330489.825084:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330489.825092:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:22684:x1875199792501632:12345-0@lo:104: 00010000:00010000:3.0:1788330489.825105:0:22652:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.825213:0:22652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330489.825219:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:22684:x1875199792501632:12345-0@lo:104: Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.825227:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330489.825243:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330489.825249:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:22684:x1875199792501760:12345-0@lo:104: 00010000:00010000:3.0:1788330489.825256:0:22652:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330489.825286:0:22652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788330489.825291:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:22684:x1875199792501760:12345-0@lo:104: Request processed in 43us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.825297:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330489.825325:0:22684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792501632:0@lo:104: 00000100:00100000:3.0:1788330489.825333:0:22684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792501760:0@lo:104: 00010000:00010000:3.0:1788330489.825351:0:22684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825461:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330489.825468:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825476:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330489.825480:0:22657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825488:0:22657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330489.825507:0:22657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330489.825512:0:22657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788330489.825541:0:22657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825556:0:22657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330489.825578:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825595:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd29ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd29f5 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825607:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330489.825611:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825617:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330489.825620:0:22657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825626:0:22657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330489.825632:0:22657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330489.825638:0:22657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788330489.825659:0:22657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825664:0:22657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330489.825671:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825677:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e78a00/0x8475908e9fd292a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2931 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825692:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330489.825694:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330489.825696:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330489.825702:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330489.825719:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792501888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330489.825749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330489.825777:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330489.825782:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792502016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330489.825802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330489.825843:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792501888 00000100:00100000:2.0:1788330489.825847:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792501888 00010000:00010000:2.0:1788330489.825866:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd29ee expref: 18 pid: 22662 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330489.825885:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792502016 00000100:00100000:2.0:1788330489.825888:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792502016 00010000:00010000:2.0:1788330489.825899:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd292a expref: 19 pid: 22663 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330489.825911:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330489.825917:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:3648:x1875199792501888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330489.825947:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330489.825952:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd29ee expref: 19 pid: 22662 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825962:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd29ee expref: 19 pid: 22662 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825975:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064000/0x8475908e9fd29f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd29ee expref: 19 pid: 22662 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.825987:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330489.826014:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:3648:x1875199792501888:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.826021:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330489.826035:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330489.826041:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:3648:x1875199792502016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330489.826048:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330489.826052:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd292a expref: 17 pid: 22663 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826059:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd292a expref: 17 pid: 22663 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826068:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064200/0x8475908e9fd2931 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd292a expref: 17 pid: 22663 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826078:0:22655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826085:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788330489.826105:0:22655:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007772556s 00010000:00010000:2.0:1788330489.826109:0:22655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826115:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826121:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826126:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826131:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330489.826135:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826141:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826173:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826182:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330489.826205:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+16:3648:x1875199792502016:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.826211:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788330489.826236:0:22684:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826252:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330489.826257:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147b000/0x8475908e9fd2a2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330489.826284:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792502016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330489.826291:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792501888:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788330489.836108:0:23401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788330489.837091:0:23426:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788330489.837454:0:23401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788330489.837967:0:23427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23427:1875199792502144:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788330489.838048:0:23427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.838086:0:23427:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765da80 going to sleep for 11 seconds 00000040:01000000:0.0:1788330489.838268:0:23401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788330489.838309:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788330489.838877:0:23401:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788330489.838885:0:23401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788330489.838924:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330489.839598:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792502144 00000100:00100000:2.0:1788330489.839608:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792502144 00000100:00100000:2.0:1788330489.839655:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330489.839666:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23427:x1875199792502144:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788330489.839783:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23427:x1875199792502144:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.839791:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1788330489.839841:0:23426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330489.841856:0:23426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788330489.841930:0:23426:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788330489.842840:0:23401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788330489.843785:0:23427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23427:1875199792502144:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788330489.843892:0:23427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788330489.844032:0:23427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23427:1875199792502272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788330489.844237:0:23427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.844291:0:23427:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765da80 going to sleep for 11 seconds 00000040:00080000:0.0:1788330489.844819:0:23401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788330489.844887:0:23401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788330489.845013:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788330489.845535:0:23425:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788330489.845540:0:23425:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00080000:10000000:0.0:1788330489.846054:0:23401:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:2.0:1788330489.846537:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792502272 00000100:00100000:2.0:1788330489.846566:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792502272 00000100:00100000:2.0:1788330489.848913:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788330489.848932:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23427:x1875199792502272:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788330489.849122:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23427:x1875199792502272:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 196us (4885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.849140:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00000004:0.0:1788330489.849935:0:23401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788330489.850105:0:23427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23427:1875199792502272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788330489.850218:0:23427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23427:1875199792502400:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788330489.850264:0:23427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.850293:0:23427:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330489.850427:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792502400 00000100:00100000:2.0:1788330489.850435:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792502400 00000100:00100000:2.0:1788330489.850479:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330489.850488:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23427:x1875199792502400:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788330489.850535:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23427:x1875199792502400:12345-0@lo:900:lod0001_rec0000.0 Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330489.850542:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788330489.850736:0:23427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99eec995f100 x1875199792502400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330505 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330489.850748:0:23427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23427:1875199792502400:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788330489.850795:0:23427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23427:1875199792502528:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788330489.850823:0:23427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330489.850844:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792502528 00000100:00100000:3.0:1788330489.850847:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792502528 00000100:00100000:3.0:1788330489.850874:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330489.850883:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23427:x1875199792502528:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788330489.850939:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23427:x1875199792502528:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 57us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330489.850946:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330489.850962:0:23427:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330489.850988:0:23427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23427:1875199792502528:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788330489.851030:0:23427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330489.855100:0:23427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788330489.855208:0:23427:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788330489.855214:0:23427:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788330489.855663:0:23401:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788330489.855688:0:23401:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb7bcc0d53988 00100000:10000000:2.0:1788330489.855697:0:23401:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788330489.856351:0:23401:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788330489.856399:0:23401:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788330489.856432:0:23401:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788330489.856450:0:23401:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788330489.857523:0:23401:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330489.857783:0:23401:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330490.331733:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330490.783216:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000040:00080000:1.0:1788330490.844775:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788330491.355839:0:22666:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788330491.355846:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d04000 from 12 10000000:01000000:0.0:1788330491.355851:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788330491.355897:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330491.355907:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330491.355916:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330491.355937:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792502656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330491.356002:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330491.356077:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7200c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788330491.356175:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330491.356444:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792502656 00000100:00100000:1.0:1788330491.356453:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792502656 00000100:00100000:1.0:1788330491.356521:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788330491.356542:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+16:22666:x1875199792502656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330491.356556:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330491.356571:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2a34 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330491.356594:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 17 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330491.356605:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 17 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330491.356615:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064200, rc 0) 00000100:00100000:1.0:1788330491.356844:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792502656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330491.356852:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330491.357174:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792502656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330491.357195:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330491.357206:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330491.357263:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792502784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788330491.357302:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330491.357336:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330491.357351:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792502784 00000100:00100000:0.0:1788330491.357356:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792502784 00000100:00100000:0.0:1788330491.357514:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788330491.357523:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792502784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330491.357558:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330491.357575:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330491.357578:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788330491.357887:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792502784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 364us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330491.357895:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788330491.357943:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792502784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788330491.357985:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330491.357992:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330491.358001:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330491.358011:0:22666:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788330491.358013:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee7213000 from 12 10000000:01000000:3.0:1788330491.358016:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330491.358034:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330491.358046:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330491.358054:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330491.358066:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792502912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330491.358089:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330491.358175:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330491.358860:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792502912 00000100:00100000:1.0:1788330491.358916:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792502912 00000100:00100000:1.0:1788330491.358961:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788330491.358969:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792502912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330491.358978:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330491.358998:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2a42 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330491.359018:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 18 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330491.359029:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 18 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330491.359038:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064000, rc 0) 00000100:00100000:1.0:1788330491.359073:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:22666:x1875199792502912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330491.359079:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330491.359180:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792502912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330491.359192:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330491.359200:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330491.359244:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792503040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788330491.359270:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330491.359297:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330491.359895:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792503040 00000100:00100000:1.0:1788330491.359902:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792503040 00000100:00100000:1.0:1788330491.359942:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788330491.360007:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:22666:x1875199792503040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788330491.360022:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788330491.360043:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788330491.360046:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788330491.360372:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:22666:x1875199792503040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 366us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330491.360380:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788330491.360788:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792503040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788330491.360848:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330491.360857:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330491.360866:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330491.803278:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000040:00080000:1.0:1788330491.868339:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330492.379404:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330492.827257:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:2.0:1788330493.403406:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330493.851276:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00010000:00010000:3.0:1788330494.431318:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788330494.875795:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788330494.875803:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788330494.875807:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330494.875821:0:23217:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc67e9800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330494.875857:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fdc00 x1875199792503296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330494.875874:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330494.875877:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330494.875885:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330494.875888:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330494.875927:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330494.875931:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330494.875933:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330494.875936:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788330494.875971:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792503168:0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.876045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330494.876094:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330494.876100:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792503424:0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.876128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330494.876182:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792503296:0@lo:38:kworker.0 00000100:00100000:1.0:1788330494.876200:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 0 seconds 00000100:00100000:2.0:1788330494.876374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330494.876409:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792503552:0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.876435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330494.876451:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330494.876457:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792503680:0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.876476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330494.876520:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792503168 00000100:00100000:2.0:1788330494.876528:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792503168 00000100:00100000:2.0:1788330494.876575:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330494.876585:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:3646:x1875199792503168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.876634:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:3646:x1875199792503168:12345-0@lo:400:kworker.0 Request processed in 50us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.876647:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330494.876682:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792503424 00000100:00100000:2.0:1788330494.876687:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792503424 00000100:00100000:2.0:1788330494.876710:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792503680 00000100:00100000:2.0:1788330494.876713:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792503680 00000100:00100000:2.0:1788330494.876725:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330494.876730:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792503424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.876761:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792503424:12345-0@lo:400:kworker.0 Request processed in 30us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.876766:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330494.876776:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330494.876780:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792503680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.876804:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792503680:12345-0@lo:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.876810:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330494.876841:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792503296 00000100:00100000:2.0:1788330494.876844:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792503296 00000100:00100000:2.0:1788330494.876856:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792503552 00000100:00100000:2.0:1788330494.876858:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792503552 00000100:00100000:2.0:1788330494.876873:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330494.876878:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792503296:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788330494.876901:0:22674:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 698 last 0 00000020:00000080:2.0:1788330494.877265:0:22674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd2a50 00000004:00100000:2.0:1788330494.877283:0:22674:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788330494.877289:0:22674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:2.0:1788330494.877397:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc72ff480 x1875199792503680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330494.877415:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792503680:0@lo:400:kworker.0 00010000:00080000:2.0:1788330494.877447:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc72ff800 x1875199792503424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330494.877455:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792503424:0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.877463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792503168:0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.878128:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330494.878142:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792503808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330494.878453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330494.882438:0:22673:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788330494.886786:0:22673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:2.0:1788330494.887084:0:22674:0:(import.c:65:import_set_state_nolock()) ffff99eeffbd7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330494.887240:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792503296:12345-0@lo:38:kworker.0 Request processed in 10359us (10864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.887252:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330494.887282:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792503808 00000100:00100000:2.0:1788330494.887291:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792503808 00000100:00100000:2.0:1788330494.887325:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330494.887333:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875199792503552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.887382:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875199792503552:12345-0@lo:400:kworker.0 Request processed in 50us (10946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.887389:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330494.887402:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330494.887408:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792503808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330494.887430:0:22674:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788330494.887465:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792503808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (9013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.887484:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788330494.887548:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788330494.887558:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788330494.887565:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788330494.887567:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788330494.887584:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000885b41ae): req@ffff99eeffc9b800 x1875199792496384/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330494.887607:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792503296:0@lo:38:kworker.0 00000100:00100000:2.0:1788330494.887678:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330494.887701:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330494.887731:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792503808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330494.887761:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792503552:0@lo:400:kworker.0 00000100:00100000:2.0:1788330494.887781:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792496384 00000100:00100000:2.0:1788330494.887785:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792496384 00000100:00100000:2.0:1788330494.887804:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330494.887810:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22709:x1875199792496384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330494.887873:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22709:x1875199792496384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.887879:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330494.887900:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22709:1875199792496384:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788330494.887943:0:22709:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788330494.887984:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22709:1875199792503936:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330494.888012:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330494.888036:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec13ce180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330494.888055:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792503936 00000100:00100000:2.0:1788330494.888058:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792503936 00000100:00100000:2.0:1788330494.888077:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330494.888083:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22709:x1875199792503936:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330494.888213:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22709:x1875199792503936:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.888219:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330494.888245:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22709:1875199792503936:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330494.888315:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22709:1875199792504064:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330494.888337:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330494.888350:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec13cea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330494.888361:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792504064 00000100:00100000:2.0:1788330494.888365:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792504064 00000100:00100000:2.0:1788330494.888381:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330494.888387:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22709:x1875199792504064:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330494.888433:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22709:x1875199792504064:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.888439:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330494.888463:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22709:1875199792504064:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788330494.888514:0:22709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788330494.891187:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330494.891419:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792504192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330494.891490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788330494.893228:0:22709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788330494.893309:0:22709:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1788330494.893316:0:22709:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1788330494.893376:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792504192 00000100:00100000:2.0:1788330494.893386:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792504192 00000100:00100000:2.0:1788330494.893435:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788330494.893446:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792504192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330494.893487:0:22673:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330494.893575:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792504192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330494.893582:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330494.894412:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792504192:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788330494.903974:0:23670:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788330495.455320:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788330495.852456:0:23724:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330495.852674:0:23724:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330496.476677:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788330496.810919:0:23774:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330496.811185:0:23774:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330497.499610:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330497.887089:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1788330498.054758:0:23822:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2f7823b0 20000000:00000080:3.0:1788330498.055192:0:23822:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99eefface000 uarg=0000000000000000 20000000:01000000:3.0:1788330498.055252:0:23822:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788330498.055263:0:23822:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788330498.055270:0:23822:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788330498.057250:0:23823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788330498.058253:0:23822:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788330498.080969:0:23822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788330498.081017:0:23822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.081042:0:23822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.081052:0:23822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd29fc expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.081060:0:23822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.082569:0:23822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd29fc expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.083569:0:23822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd29fc expref: 17 pid: 22663 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330498.083606:0:23822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23822:1875199792504320:0@lo:104: 00000100:00100000:1.0:1788330498.083718:0:23822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330498.083809:0:23822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.083820:0:23822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 17 pid: 22662 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330498.083828:0:23822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23822:1875199792504448:0@lo:104: 00000100:00100000:1.0:1788330498.083853:0:23822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330498.084449:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792504320 00000100:00100000:1.0:1788330498.084460:0:23822:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330498.084463:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792504320 00000100:00100000:2.0:1788330498.084540:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792504448 00000100:00100000:2.0:1788330498.084545:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792504448 00000100:00100000:2.0:1788330498.084563:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330498.084574:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:23822:x1875199792504320:12345-0@lo:104: 00010000:00010000:2.0:1788330498.084591:0:22652:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.084690:0:22652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330498.084698:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:23822:x1875199792504320:12345-0@lo:104: Request processed in 126us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330498.084707:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330498.084729:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330498.084735:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:23822:x1875199792504448:12345-0@lo:104: 00010000:00010000:2.0:1788330498.084744:0:22652:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330498.085626:0:23822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23822:1875199792504320:0@lo:104: 00000100:00100000:1.0:1788330498.085642:0:23822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23822:1875199792504448:0@lo:104: 00010000:00010000:1.0:1788330498.085675:0:23822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.085879:0:22652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788330498.085911:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:23822:x1875199792504448:12345-0@lo:104: Request processed in 1174us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330498.085921:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788330498.085957:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330498.085965:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.085974:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330498.085979:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.085989:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330498.085996:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330498.086004:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330498.086058:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.086065:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330498.086090:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.086097:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd29fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a03 expref: -99 pid: 23401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.086113:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330498.086117:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.086135:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ae00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330498.086138:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.086146:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330498.086177:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330498.086183:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330498.087012:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.087025:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330498.087040:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.087047:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd28f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2900 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330498.087070:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330498.087072:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330498.087074:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330498.087097:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792504576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330498.087407:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792504704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330498.087488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330498.087919:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330498.087983:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330498.088049:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792504704 00000100:00100000:0.0:1788330498.088061:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792504704 00010000:00010000:0.0:1788330498.088111:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 18 pid: 22662 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330498.088184:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792504576 00000100:00100000:0.0:1788330498.088190:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792504576 00000100:00100000:1.0:1788330498.088198:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330498.088211:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:3649:x1875199792504704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330498.088230:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330498.088237:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 19 pid: 22662 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.088250:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 19 pid: 22662 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.088273:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9038e00/0x8475908e9fd2900 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd28f9 expref: 19 pid: 22662 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.088308:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330498.088334:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd29fc expref: 18 pid: 22663 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330498.088359:0:22656:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788330498.088368:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788330498.088494:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:3649:x1875199792504704:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330498.088502:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330498.088519:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792504704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330498.088536:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788330498.088543:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:3648:x1875199792504576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330498.088551:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330498.088556:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd29fc expref: 17 pid: 22663 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.088566:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd29fc expref: 17 pid: 22663 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.088742:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147b600/0x8475908e9fd2a03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd29fc expref: 17 pid: 22663 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.088756:0:22654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.088766:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.089012:0:22654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.089020:0:22654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.089028:0:22654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.089035:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.089041:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330498.089045:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.089054:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.089444:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330498.089486:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330498.090361:0:23822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330498.090378:0:23822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330498.090399:0:23822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064e00/0x8475908e9fd2a57 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330498.090951:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+16:3648:x1875199792504576:12345-0@lo:103:ldlm_bl.0 Request processed in 2402us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330498.090965:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330498.091032:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792504576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330498.532817:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330499.552944:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788330499.931383:0:22666:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330499.931392:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7d04000 from 13 10000000:01000000:1.0:1788330499.931398:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330499.931465:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330499.931480:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330499.931492:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330499.931523:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792504832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.931611:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330499.931664:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788330499.931725:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792504832 00000100:00100000:0.0:1788330499.931734:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792504832 00000100:00100000:0.0:1788330499.931795:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330499.931806:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+16:22666:x1875199792504832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330499.931820:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330499.931834:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2a5e expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330499.931857:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330499.931867:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330499.931877:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78800, rc 0) 00000100:00100000:0.0:1788330499.931928:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792504832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330499.931935:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788330499.932017:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792504832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330499.932032:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330499.932041:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330499.932101:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792504960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.932147:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330499.932198:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330499.932298:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792504960 00000100:00100000:2.0:1788330499.932303:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792504960 00000100:00100000:2.0:1788330499.932340:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788330499.932349:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792504960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330499.932491:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792504960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330499.932498:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788330499.932644:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792504960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.932671:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792505088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.932709:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330499.932734:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330499.933064:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792505088 00000100:00100000:2.0:1788330499.933070:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792505088 00000100:00100000:2.0:1788330499.933133:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788330499.933140:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792505088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330499.933275:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792505088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330499.933282:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788330499.933411:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792505088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788330499.934080:0:23892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788330499.934145:0:22666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788330499.934183:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330499.934193:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330499.934202:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330499.934213:0:22666:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330499.934216:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eee7213000 from 13 10000000:01000000:1.0:1788330499.934219:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330499.934247:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330499.934256:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330499.934265:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330499.934284:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792505216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.934343:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330499.936705:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330499.936864:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792505216 00000100:00100000:0.0:1788330499.936875:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792505216 00000100:00100000:0.0:1788330499.936938:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788330499.936951:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+17:22666:x1875199792505216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330499.936968:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330499.936989:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2a6c expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330499.937035:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 18 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330499.937046:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 18 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330499.937055:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78a00, rc 0) 00000100:00100000:0.0:1788330499.937137:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:22666:x1875199792505216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (2794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330499.937143:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788330499.937387:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792505216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330499.937406:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330499.937415:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330499.937500:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792505344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.937535:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330499.937562:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330499.939647:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792505344 00000100:00100000:0.0:1788330499.939668:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792505344 00000100:00100000:0.0:1788330499.939737:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788330499.939748:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:22666:x1875199792505344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330499.939955:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:22666:x1875199792505344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330499.939963:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788330499.941053:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792505344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.941108:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792505472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.941185:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330499.941229:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330499.941247:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792505472 00000100:00100000:1.0:1788330499.941252:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792505472 00000100:00100000:1.0:1788330499.941404:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788330499.941412:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:22666:x1875199792505472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330499.941530:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:22666:x1875199792505472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330499.941538:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788330499.941582:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792505472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788330499.945468:0:23893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788330499.945958:0:22666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788330499.945987:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330499.946001:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330499.946015:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330499.995567:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330489/real 1788330489] req@ffff99edc72fc380 x1875199792499456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330499.995605:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc72fc380 x1875199792499456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330499.995687:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330489/real 1788330489] req@ffff99edc72fd180 x1875199792499328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330499.995703:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc72fd180 x1875199792499328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788330499.995741:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330499.995803:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788330499.995808:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792499456:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788330499.995814:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f30800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330499.998106:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330499.998114:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330499.998117:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330499.998132:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330499.998178:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330499.998181:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788330499.998185:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99edc5f30800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330499.998193:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 693 00000100:00080000:2.0:1788330499.998199:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330499.998206:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99edc5f30800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330499.998233:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7697480 x1875199792505984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330499.998245:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330499.998248:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788330499.998249:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330499.998253:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 693 00000100:00080000:2.0:1788330499.998256:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330499.998259:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99eeffa6f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330499.998302:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7697100 x1875199792506112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330499.998369:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792505856:0@lo:400:kworker.0 00000100:00100000:2.0:1788330499.998461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330499.998511:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330499.998517:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792506240:0@lo:400:kworker.0 00000100:00100000:2.0:1788330499.998544:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330499.998577:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792505856 00000100:00100000:2.0:1788330499.998585:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792505856 00000100:00100000:2.0:1788330499.998869:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330499.998893:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792505856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330499.998956:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792505856:12345-0@lo:400:kworker.0 Request processed in 66us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330499.998964:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330499.998990:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792506240 00000100:00100000:2.0:1788330499.998994:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792506240 00000100:00100000:2.0:1788330499.999020:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330499.999027:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792506240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330499.999055:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792506240:12345-0@lo:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330499.999061:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788330499.999094:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc7694380 x1875199792506240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330499.999109:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792506240:0@lo:400:kworker.0 00000100:00100000:2.0:1788330499.999118:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792505856:0@lo:400:kworker.0 00000100:00080000:0.0:1788330500.001189:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788330500.001200:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792499328:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788330500.001238:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792505984:0@lo:8:kworker.0 00000400:00000100:0.0:1788330500.001302:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792505984 offset 0 length 520: 4 00000100:00100000:0.0:1788330500.001342:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792506112:0@lo:8:kworker.0 00000400:00000100:0.0:1788330500.001387:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792506112 offset 0 length 520: 4 00000100:00100000:0.0:1788330500.001416:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792505728:0@lo:400:kworker.0 00000100:00100000:0.0:1788330500.001448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330500.001480:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792506496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330500.001518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330500.001539:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788330500.001545:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792505600:0@lo:400:kworker.0 00000100:00100000:0.0:1788330500.001566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330500.001580:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792506368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330500.001594:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330500.001785:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792506496 00000100:00100000:0.0:1788330500.001792:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792506496 00000100:00100000:0.0:1788330500.001826:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792505600 00000100:00100000:0.0:1788330500.001829:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792505600 00000100:00100000:0.0:1788330500.001853:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792506368 00000100:00100000:0.0:1788330500.001856:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792506368 00000100:00100000:0.0:1788330500.001869:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330500.001877:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792506496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330500.001912:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788330500.001957:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792506496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330500.001964:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330500.001979:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788330500.001985:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792505600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330500.002008:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792505600:12345-0@lo:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330500.002014:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788330500.002023:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330500.002028:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792506368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330500.002041:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330500.002062:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792506368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 34us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330500.002067:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330500.002100:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792505600:0@lo:400:kworker.0 00000100:00100000:0.0:1788330500.002111:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792506368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330500.002120:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792506496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330500.002722:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792505728 00000100:00100000:3.0:1788330500.002728:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792505728 00000100:00100000:3.0:1788330500.002763:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330500.002769:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792505728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330500.002820:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792505728:12345-0@lo:400:kworker.0 Request processed in 51us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330500.002826:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788330500.002864:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc72fd880 x1875199792505728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330500.002876:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792505728:0@lo:400:kworker.0 00000100:00080000:2.0:1788330500.003383:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330500.003389:0:13408:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330500.003392:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330500.003395:0:13408:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788330500.573839:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330501.021242:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330485/real 1788330485] req@ffff99eec995c380 x1875199792497536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330500 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330501.021276:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eec995c380 x1875199792497536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330500 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330501.021449:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330485/real 1788330485] req@ffff99eec995ed80 x1875199792497664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330500 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330501.021466:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eec995ed80 x1875199792497664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330500 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330501.021485:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eef59c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330501.021516:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330501.021520:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792497536:0@lo:8:kworker.0 00000100:00080000:3.0:1788330501.021526:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330501.021531:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330501.021534:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792497664:0@lo:8:kworker.0 00000100:00080000:0.0:1788330501.021705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330501.021709:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788330501.021712:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eef59c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330501.021725:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 689 00000100:00080000:0.0:1788330501.021730:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788330501.021736:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99eef59c0000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330501.021769:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffc9aa00 x1875199792506880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330501.021781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330501.021784:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788330501.021786:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330501.021789:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 689 00000100:00080000:0.0:1788330501.021792:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788330501.021796:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99edc7d06800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330501.021801:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792506624:0@lo:400:kworker.0 00000100:00100000:0.0:1788330501.021806:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffc9b800 x1875199792507008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330501.021838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330501.021841:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330501.021844:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330501.021846:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330501.021866:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792506752:0@lo:400:kworker.0 00000100:00100000:2.0:1788330501.021870:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330501.021913:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330501.021925:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792507392:0@lo:400:kworker.0 00000100:00100000:0.0:1788330501.021949:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792506752 00000100:00100000:2.0:1788330501.021951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330501.021955:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792506752 00000100:00100000:2.0:1788330501.021977:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792506624 00000100:00100000:2.0:1788330501.021981:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792506624 00000100:00100000:0.0:1788330501.021997:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788330501.022004:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788330501.022006:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792506752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330501.022009:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:3648:x1875199792506624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330501.022054:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:3648:x1875199792506624:12345-0@lo:400:kworker.0 Request processed in 43us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330501.022054:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792506752:12345-0@lo:400:kworker.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330501.022061:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788330501.022065:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788330501.022093:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792507392 00000100:00100000:2.0:1788330501.022096:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792507392 00000100:00100000:0.0:1788330501.022101:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792506752:0@lo:400:kworker.0 00000100:00100000:2.0:1788330501.022117:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330501.022123:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792507392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330501.022248:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792507392:12345-0@lo:400:kworker.0 Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330501.022254:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788330501.022374:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792507136:0@lo:400:kworker.0 00010000:00080000:2.0:1788330501.022390:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eeffc99180 x1875199792507392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330501.022400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330501.022418:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330501.022423:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792507264:0@lo:400:kworker.0 00000100:00100000:0.0:1788330501.022455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330501.022481:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792507264 00000100:00100000:2.0:1788330501.022484:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792507392:0@lo:400:kworker.0 00000100:00100000:0.0:1788330501.022484:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792507264 00000100:00100000:2.0:1788330501.022495:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792506624:0@lo:400:kworker.0 00000100:00100000:0.0:1788330501.022508:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788330501.022514:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792507264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330501.022548:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792507264:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330501.022555:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788330501.022578:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792507264:0@lo:400:kworker.0 00000100:00100000:3.0:1788330501.022663:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792507136 00000100:00100000:3.0:1788330501.022668:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792507136 00000100:00100000:3.0:1788330501.022701:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330501.022708:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792507136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330501.022751:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792507136:12345-0@lo:400:kworker.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330501.022758:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330501.022781:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792506880:0@lo:8:kworker.0 00000400:00000100:3.0:1788330501.022804:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792506880 offset 0 length 520: 4 00000100:00100000:3.0:1788330501.022824:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792507008:0@lo:8:kworker.0 00000400:00000100:3.0:1788330501.022845:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792507008 offset 0 length 520: 4 00010000:00080000:0.0:1788330501.024070:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eeffc9bb80 x1875199792507136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330501.024087:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792507136:0@lo:400:kworker.0 00000001:00100000:2.0:1788330501.026140:0:23402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1788330501.083971:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330501.596363:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330502.627019:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330503.648485:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330504.667280:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330505.115997:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792507520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330505.116082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.116187:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792507520 00000100:00100000:1.0:1788330505.116196:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792507520 00000100:00100000:1.0:1788330505.116245:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330505.116256:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792507520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330505.116289:0:22673:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788330505.116542:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330505.116772:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792507648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330505.116815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330505.116848:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792507648 00000100:00100000:3.0:1788330505.116852:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792507648 00000100:00100000:3.0:1788330505.116874:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788330505.116880:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792507648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330505.116900:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788330505.117135:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792507648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 254us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330505.117144:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788330505.117311:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792507648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330505.117418:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792507520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1164us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.117421:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792507520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330505.117425:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000004:3.0:1788330505.403439:0:24171:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788330505.403443:0:24171:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788330505.403444:0:24171:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788330505.403565:0:24171:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99eef590d000 00000020:01000004:3.0:1788330505.403585:0:24171:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788330505.403598:0:24171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788330505.403612:0:24171:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99eee7648000) 00000020:00000080:3.0:1788330505.403629:0:24171:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788330505.497789:0:24171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788330505.501444:0:24171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788330505.503801:0:24171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788330505.504417:0:24171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788330505.504890:0:24171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788330505.505230:0:24171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788330505.507990:0:24171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1788330505.523850:0:24171:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788330505.524077:0:24171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788330505.524091:0:24171:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788330505.524103:0:24171:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8475908e9fd2a81 00000020:01000004:0.0:1788330505.524110:0:24171:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788330505.524132:0:24171:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788330505.524136:0:24171:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788330505.524143:0:24171:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788330505.524213:0:24171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788330505.524228:0:24171:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99eef5830000) 00000020:00000080:0.0:1788330505.524241:0:24171:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788330505.527575:0:24171:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330505.527802:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788330505.527809:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788330505.543905:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788330505.543922:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788330505.544739:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788330505.544751:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788330505.551449:0:24171:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330505.551673:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788330505.551681:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788330505.557061:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788330505.557086:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788330505.589016:0:24171:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330505.589586:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788330505.589593:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788330505.592357:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788330505.592372:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788330505.596558:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788330505.596578:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788330505.600725:0:24171:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788330505.600950:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788330505.600955:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788330505.602920:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788330505.603028:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788330505.635611:0:24171:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330505.635856:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788330505.635865:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788330505.637340:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788330505.637352:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788330505.637791:0:24171:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788330505.637824:0:24171:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788330505.637831:0:24171:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788330505.685612:0:24171:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788330505.685663:0:24171:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788330505.685668:0:24171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788330505.685670:0:24171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788330505.685671:0:24171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330505.685672:0:24171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330505.685673:0:24171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330505.685675:0:24171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330505.685676:0:24171:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788330505.685678:0:24171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330505.685679:0:24171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788330505.685684:0:24171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788330505.685686:0:24171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788330505.685687:0:24171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788330505.685694:0:24171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330505.685695:0:24171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330505.685696:0:24171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330505.685697:0:24171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330505.685698:0:24171:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788330505.685699:0:24171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330505.685700:0:24171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788330505.685734:0:24171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788330505.686843:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792507776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788330505.686936:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330505.687053:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330505.692363:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792507776 00000100:00100000:0.0:1788330505.692380:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792507776 00000100:00100000:0.0:1788330505.693144:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788330505.693184:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:24171:x1875199792507776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788330505.693225:0:22664:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788330505.693229:0:22664:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788330505.693233:0:22664:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788330505.694673:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330505.696222:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:24171:x1875199792507776:12345-0@lo:253:mount.lustre.0 Request processed in 3034us (9276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.696238:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788330505.698029:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792507776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330505.698053:0:24171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788330505.698057:0:24171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330505.698060:0:24171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788330505.698061:0:24171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330505.698062:0:24171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330505.698063:0:24171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330505.698065:0:24171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330505.698066:0:24171:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330505.698068:0:24171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330505.698069:0:24171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788330505.698094:0:24171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99eef590d000 from lustre-OST0000 10000000:01000000:3.0:1788330505.698133:0:24171:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788330505.698136:0:24171:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788330505.698146:0:24171:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99eec8bb4d28 local copy 00010000:00010000:3.0:1788330505.698175:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330505.698282:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792507904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330505.698353:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330505.701721:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792507904 00000100:00100000:2.0:1788330505.701739:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792507904 00000100:00100000:0.0:1788330505.701956:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788330505.701970:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:24171:x1875199792507904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330505.702135:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:24171:x1875199792507904:12345-0@lo:501:mount.lustre.0 Request processed in 167us (3780us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330505.702143:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788330505.702242:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc719ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330505.702269:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792507904:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788330505.702291:0:24171:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788330505.702322:0:24171:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788330505.702331:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330505.702343:0:24171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330505.702382:0:24171:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99eef590d000 10000000:01000000:0.0:1788330505.702388:0:24171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788330505.702395:0:24171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788330505.702411:0:24171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330505.702416:0:24171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788330505.702419:0:24171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788330505.702462:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79000/0x8475908e9fd2a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330505.702802:0:24171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79000/0x8475908e9fd2a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330505.702813:0:24171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79000/0x8475908e9fd2a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330505.702859:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330505.702908:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.702939:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788330505.702981:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792508032 00000100:00100000:0.0:1788330505.702999:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792508032 00000100:00100000:0.0:1788330505.703026:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788330505.703034:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+18:24171:x1875199792508032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330505.703044:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330505.703059:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd2a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2a8f expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330505.703082:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd2a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2a8f expref: 19 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330505.703093:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd2a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a8f expref: 19 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330505.703102:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78e00, rc 0) 00000100:00100000:0.0:1788330505.703142:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508032:12345-0@lo:101:mount.lustre.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.703177:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788330505.707314:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330505.707354:0:24171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79000/0x8475908e9fd2a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a96 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.707370:0:24171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79000/0x8475908e9fd2a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2a96 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330505.709856:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788330505.715075:0:24171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330505.718974:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788330505.719036:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788330505.719050:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788330505.719064:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788330505.719076:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788330505.719088:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788330505.719111:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788330505.719125:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788330505.719140:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788330505.719185:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788330505.719204:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788330505.719218:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788330505.719248:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788330505.719256:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788330505.719392:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330505.721868:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.721977:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330505.722089:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792508160 00000100:00100000:3.0:1788330505.722100:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792508160 00000100:00100000:3.0:1788330505.722262:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788330505.722274:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330505.722475:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508160:12345-0@lo:501:mount.lustre.0 Request processed in 204us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330505.722484:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788330505.722576:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330505.722627:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330505.722678:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.725251:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330505.725363:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792508288 00000100:00100000:2.0:1788330505.725372:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792508288 00000100:00100000:2.0:1788330505.725436:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788330505.725446:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330505.726297:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508288:12345-0@lo:503:mount.lustre.0 Request processed in 847us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330505.726307:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788330505.726349:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788330505.726944:0:24171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788330505.727037:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330505.727095:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.727629:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc719a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330505.727725:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792508416 00000100:00100000:3.0:1788330505.727733:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792508416 00000100:00100000:3.0:1788330505.727777:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788330505.727786:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330505.728316:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508416:12345-0@lo:502:mount.lustre.0 Request processed in 530us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330505.728325:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330505.728524:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330505.728770:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788330505.728804:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788330505.728822:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788330505.728836:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788330505.728850:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788330505.728869:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788330505.728895:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788330505.728907:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788330505.728920:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788330505.728935:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788330505.728950:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788330505.728967:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788330505.729004:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330505.729056:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.729143:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc719a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330505.729249:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792508544 00000100:00100000:3.0:1788330505.729257:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792508544 00000100:00100000:3.0:1788330505.729332:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788330505.729342:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330505.729479:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508544:12345-0@lo:502:mount.lustre.0 Request processed in 138us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330505.729487:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788330505.729623:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330505.729685:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788330505.729696:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788330505.733276:0:24188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788330505.733292:0:24188:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788330505.733301:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330505.733304:0:24188:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788330505.733311:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330505.733328:0:24188:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99eee764b370) 00000020:00000080:3.0:1788330505.733356:0:24188:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788330505.733503:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788330505.733619:0:24188:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eef590d000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788330505.733629:0:24188:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788330505.733638:0:24188:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8475908e9fd2aa4 00010000:00010000:3.0:1788330505.737994:0:24188:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788330505.738735:0:24188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788330505.740047:0:24188:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788330505.747945:0:24188:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788330505.747960:0:24188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330505.747966:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330505.747968:0:24188:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788330505.747972:0:24188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788330505.747975:0:24188:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788330505.747977:0:24188:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330505.747979:0:24188:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330505.747980:0:24188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788330505.747983:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330505.747984:0:24188:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788330505.747986:0:24188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330505.747988:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330505.747990:0:24188:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788330505.747992:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788330505.747999:0:24188:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788330505.748002:0:24188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330505.748004:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330505.748005:0:24188:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788330505.748008:0:24188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330505.748010:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330505.748011:0:24188:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788330505.748014:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788330505.748047:0:24188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330505.748049:0:24188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330505.748050:0:24188:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788330505.748053:0:24188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788330505.750598:0:24171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788330505.750657:0:24171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788330505.750686:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79000/0x8475908e9fd2a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a96 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.750701:0:24171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79000/0x8475908e9fd2a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2a96 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330505.750710:0:24171:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef590d000 from 1 10000000:01000000:1.0:1788330505.750725:0:24171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330505.750768:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.750778:0:24171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.750790:0:24171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330505.750817:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330505.750891:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.750935:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717300 going to sleep for 11 seconds 00000100:00100000:1.0:1788330505.750976:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792508672 00000100:00100000:1.0:1788330505.750983:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792508672 00000100:00100000:1.0:1788330505.751025:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788330505.751035:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:24171:x1875199792508672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330505.751048:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330505.751062:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2aab expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.751098:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2aab expref: 20 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.751108:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2aab expref: 20 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.751117:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02065600, rc 0) 00000100:00100000:1.0:1788330505.751563:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792508672:12345-0@lo:101:mount.lustre.0 Request processed in 527us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330505.751580:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788330505.751653:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330505.751669:0:24171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.751679:0:24171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330505.757751:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788330505.758117:0:24171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330505.759809:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788330505.759848:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788330505.759864:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788330505.759878:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788330505.759890:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788330505.759901:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788330505.759913:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788330505.759925:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788330505.759937:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788330505.759948:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788330505.759961:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788330505.759977:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788330505.759983:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788330505.760079:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330505.760189:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.760234:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717600 going to sleep for 11 seconds 00000100:00100000:2.0:1788330505.761345:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792508800 00000100:00100000:2.0:1788330505.761371:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792508800 00000100:00100000:2.0:1788330505.761443:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788330505.761457:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792508800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330505.761630:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792508800:12345-0@lo:501:mount.lustre.0 Request processed in 176us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330505.761639:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330505.763550:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330505.763620:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330505.763701:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.763742:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330505.763827:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792508928 00000100:00100000:0.0:1788330505.763834:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792508928 00000100:00100000:0.0:1788330505.763873:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788330505.763882:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792508928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330505.764004:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792508928:12345-0@lo:503:mount.lustre.0 Request processed in 123us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.764012:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788330505.764679:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792508928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788330505.765090:0:24171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330505.767456:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330505.767562:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.767615:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717300 going to sleep for 11 seconds 00000100:00100000:0.0:1788330505.769599:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792509056 00000100:00100000:0.0:1788330505.769614:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792509056 00000100:00100000:0.0:1788330505.769682:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788330505.769694:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792509056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330505.769887:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792509056:12345-0@lo:502:mount.lustre.0 Request processed in 195us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.769896:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330505.770185:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330505.770450:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788330505.770483:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788330505.770498:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788330505.770511:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788330505.770524:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788330505.770537:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788330505.770551:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788330505.770563:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788330505.770576:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788330505.770587:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788330505.770599:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788330505.770635:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330505.770688:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.770730:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330505.770787:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792509184 00000100:00100000:2.0:1788330505.770795:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792509184 00000100:00100000:2.0:1788330505.770841:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788330505.770850:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792509184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330505.770955:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792509184:12345-0@lo:502:mount.lustre.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330505.770963:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788330505.771201:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330505.771270:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788330505.771279:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788330505.781699:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330505.781716:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330505.781719:0:24192:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788330505.781730:0:24192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eef590d000 00000020:00000080:0.0:1788330505.781733:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788330505.781743:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330505.781761:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330505.781763:0:24192:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788330505.781766:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330505.781769:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330505.781771:0:24192:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788330505.781775:0:24192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eef590d000 00000020:00000080:0.0:1788330505.781777:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788330505.781854:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330505.781858:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330505.781859:0:24192:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788330505.781862:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330505.781864:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330505.781865:0:24192:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788330505.781869:0:24192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eef590d000 00000020:00000080:0.0:1788330505.781871:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788330505.781890:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330505.781892:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330505.781894:0:24192:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788330505.781897:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330505.781899:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330505.781900:0:24192:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788330505.781904:0:24192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eef590d000 00000020:00000080:0.0:1788330505.781906:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788330505.781927:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330505.781931:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330505.781932:0:24192:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788330505.781936:0:24192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788330505.794785:0:24171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788330505.794849:0:24171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330505.794903:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.794919:0:24171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330505.795018:0:24171:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788330505.795021:0:24171:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99eef590d000 10000000:01000000:1.0:1788330505.795025:0:24171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99eef590d000 10000000:01000000:1.0:1788330505.795029:0:24171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788330505.795035:0:24171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eef590d000 from 1 10000000:01000000:1.0:1788330505.795038:0:24171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788330505.795079:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd2ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.795088:0:24171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd2ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.795100:0:24171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd2ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330505.795130:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330505.795247:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.795308:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717600 going to sleep for 11 seconds 00000100:00100000:2.0:1788330505.795548:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792509312 00000100:00100000:2.0:1788330505.795558:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792509312 00000100:00100000:2.0:1788330505.795626:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788330505.795635:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:24171:x1875199792509312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330505.795649:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330505.795664:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9039a00/0x8475908e9fd2ac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2ab9 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.795692:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039a00/0x8475908e9fd2ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2ab9 expref: 21 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.795705:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9039a00/0x8475908e9fd2ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2ab9 expref: 21 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.795714:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039a00, rc 0) 00000100:00100000:2.0:1788330505.795771:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509312:12345-0@lo:101:mount.lustre.0 Request processed in 136us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330505.795778:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788330505.798304:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330505.798338:0:24171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd2ab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2ac0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.798352:0:24171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd2ab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2ac0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330505.803262:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788330505.804467:0:24171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330505.805090:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788330505.805120:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788330505.805134:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788330505.806289:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788330505.806320:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788330505.806350:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788330505.806380:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788330505.806405:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788330505.806422:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788330505.806436:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788330505.806449:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788330505.806459:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788330505.806469:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788330505.806601:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788330505.806619:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788330505.812558:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788330505.812605:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788330505.812695:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788330505.812720:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788330505.812763:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788330505.812779:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788330505.812794:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788330505.812807:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788330505.812820:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788330505.812833:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788330505.812847:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788330505.812860:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788330505.812873:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788330505.812888:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788330505.812902:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788330505.812914:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788330505.812926:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788330505.812940:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788330505.812955:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788330505.812968:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788330505.812994:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788330505.813011:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788330505.813026:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788330505.813053:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788330505.813067:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788330505.813082:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788330505.813097:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788330505.813111:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788330505.813124:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788330505.813137:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788330505.813174:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788330505.813191:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788330505.813206:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788330505.814576:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788330505.814626:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788330505.814655:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788330505.814661:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788330505.814778:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330505.814846:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.814907:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec55dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330505.814968:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792509440 00000100:00100000:3.0:1788330505.814976:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792509440 00000100:00100000:3.0:1788330505.815032:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330505.815041:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330505.815199:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509440:12345-0@lo:501:mount.lustre.0 Request processed in 158us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330505.815207:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788330505.815268:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330505.815303:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330505.815345:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.815455:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330505.820709:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792509568 00000100:00100000:0.0:1788330505.820729:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792509568 00000100:00100000:0.0:1788330505.821445:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330505.821459:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330505.821665:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509568:12345-0@lo:503:mount.lustre.0 Request processed in 209us (6318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.821673:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788330505.821816:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788330505.823486:0:24171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330505.823606:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330505.823677:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330505.824855:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788330505.825594:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792509696 00000100:00100000:3.0:1788330505.825604:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792509696 00000100:00100000:3.0:1788330505.825655:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788330505.825665:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330505.825839:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509696:12345-0@lo:502:mount.lustre.0 Request processed in 175us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330505.825848:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330505.825953:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330505.826252:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788330505.826509:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788330505.826530:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788330505.826546:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788330505.826578:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788330505.826591:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788330505.826603:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788330505.826613:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788330505.826625:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788330505.826638:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788330505.826651:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788330505.826662:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788330505.826674:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788330505.826687:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788330505.826701:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788330505.826713:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788330505.826724:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788330505.826735:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788330505.826746:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788330505.826757:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788330505.826782:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788330505.826795:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788330505.826808:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788330505.826819:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788330505.826831:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788330505.826842:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788330505.826855:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788330505.826868:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788330505.826880:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788330505.826892:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788330505.826903:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788330505.826914:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788330505.826936:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788330505.826949:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788330505.826960:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788330505.826972:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788330505.827000:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788330505.827017:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788330505.827030:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788330505.827042:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788330505.827054:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788330505.827066:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788330505.827078:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788330505.827092:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788330505.827105:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788330505.827119:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788330505.827133:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788330505.827147:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788330505.827235:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330505.827755:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330505.827850:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330505.827923:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792509824 00000100:00100000:0.0:1788330505.827936:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792509824 00000100:00100000:3.0:1788330505.828011:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788330505.828026:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330505.828706:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509824:12345-0@lo:502:mount.lustre.0 Request processed in 682us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330505.828717:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788330505.828838:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330505.829084:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788330505.829112:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788330505.829147:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330505.829247:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330505.829861:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788330505.829980:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792509952 00000100:00100000:3.0:1788330505.829988:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792509952 00000100:00100000:3.0:1788330505.830043:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788330505.830053:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330505.830220:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792509952:12345-0@lo:502:mount.lustre.0 Request processed in 168us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330505.830228:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788330505.830517:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792509952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330505.830588:0:24171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788330505.830601:0:24171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788330505.831847:0:24198:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788330505.831873:0:24198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99eef6df4d28) 00000020:00000080:3.0:1788330505.831906:0:24198:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788330505.832022:0:24198:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eef590d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788330505.832026:0:24198:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eef590d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788330505.832029:0:24198:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eef590d000 3 00010000:00080000:3.0:1788330505.832061:0:24198:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eefddee800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.150@tcp at head 00010000:00010000:0.0:1788330505.835897:0:24198:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788330505.836176:0:24198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788330505.836235:0:24198:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788330505.836251:0:24198:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8475908e9fd2ace 00000100:00080000:0.0:1788330505.836276:0:24198:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788330505.836282:0:24198:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99eefddee800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330505.836341:0:24198:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffc99180 x1875199792510080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330505.836407:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792510080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788330505.836485:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330505.836544:0:24198:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788330505.836569:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330505.836573:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330505.836576:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330505.836579:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330505.836604:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330505.836628:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330505.836631:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330505.836634:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330505.836683:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792510208:0@lo:400:kworker.0 00000100:00100000:0.0:1788330505.836713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.836746:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330505.836753:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792510336:0@lo:400:kworker.0 00000100:00100000:0.0:1788330505.836785:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.836819:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792510080 00000100:00100000:0.0:1788330505.836827:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792510080 00000100:00100000:0.0:1788330505.836848:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792510208 00000100:00100000:0.0:1788330505.836851:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792510208 00000100:00100000:0.0:1788330505.836871:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792510336 00000100:00100000:0.0:1788330505.836874:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792510336 00000100:00100000:0.0:1788330505.836889:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330505.836898:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792510208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330505.836952:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792510208:12345-0@lo:400:kworker.0 Request processed in 54us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.836959:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330505.836976:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330505.836983:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792510336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330505.837015:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792510336:12345-0@lo:400:kworker.0 Request processed in 32us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.837022:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330505.837034:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330505.837039:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875199792510080:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788330505.837065:0:22669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:0.0:1788330505.837095:0:22669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8475908e9fd2ad5 00000004:00100000:0.0:1788330505.837112:0:22669:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788330505.837181:0:22669:0:(import.c:65:import_set_state_nolock()) ffff99edc7715000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330505.837222:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875199792510080:12345-0@lo:38:llog_process_th.0 Request processed in 181us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.837228:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788330505.837268:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eeffc9b100 x1875199792510208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330505.837282:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792510208:0@lo:400:kworker.0 00010000:00080000:0.0:1788330505.837313:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc65b7480 x1875199792510336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330505.837322:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792510336:0@lo:400:kworker.0 00010000:00080000:0.0:1788330505.837342:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eeffc99180 x1875199792510080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330505.837350:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330505.837356:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788330505.837364:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788330505.837368:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788330505.837370:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eefddee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788330505.837375:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792510080:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788330505.843838:0:24198:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788330505.843866:0:24198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99eef58319b8) 00000020:00000080:0.0:1788330505.843895:0:24198:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788330505.844027:0:24198:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eef590d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788330505.844032:0:24198:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eef590d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788330505.844035:0:24198:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eef590d000 3 00010000:00080000:0.0:1788330505.844072:0:24198:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc7717800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.150@tcp at head 00010000:00010000:0.0:1788330505.847348:0:24198:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788330505.847814:0:24198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788330505.847870:0:24198:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788330505.847885:0:24198:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x8475908e9fd2ae3 00000100:00080000:0.0:1788330505.847896:0:24198:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788330505.847902:0:24198:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99edc7717800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330505.847942:0:24198:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc65b7480 x1875199792510464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330505.847974:0:24198:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788330505.848004:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330505.848009:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330505.848012:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330505.848015:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330505.848019:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330505.848022:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330505.848024:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330505.848027:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788330505.848196:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792510464:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788330505.848294:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.850353:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792510464 00000100:00100000:0.0:1788330505.850382:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792510464 00000100:00100000:0.0:1788330505.850623:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330505.850633:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875199792510464:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788330505.850678:0:22669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:0.0:1788330505.850735:0:22669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x8475908e9fd2aea 00000004:00100000:0.0:1788330505.850759:0:22669:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788330505.850799:0:22669:0:(import.c:65:import_set_state_nolock()) ffff99edc7710000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330505.850908:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875199792510464:12345-0@lo:38:llog_process_th.0 Request processed in 275us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330505.850916:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788330505.851010:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc65b7480 x1875199792510464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330505.851034:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330505.851043:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788330505.851051:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788330505.851056:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788330505.851058:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7717800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788330505.851064:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792510464:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788330505.852764:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788330505.852837:0:24171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788330505.852871:0:24171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788330505.852897:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd2ab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2ac0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330505.852911:0:24171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd2ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2ac0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788330505.852975:0:24171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788330505.852977:0:24171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788330505.852979:0:24171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330505.852980:0:24171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330505.852981:0:24171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330505.852983:0:24171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330505.852985:0:24171:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330505.852987:0:24171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330505.852988:0:24171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788330505.852993:0:24171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788330505.852995:0:24171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788330505.852997:0:24171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788330505.852998:0:24171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330505.852999:0:24171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330505.853000:0:24171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330505.853001:0:24171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330505.853007:0:24171:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330505.853008:0:24171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330505.853009:0:24171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788330505.853034:0:24171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788330505.853054:0:24171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792510592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788330505.853125:0:24171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330505.853186:0:24171:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59cda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330505.853330:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792510592 00000100:00100000:3.0:1788330505.853338:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792510592 00000100:00100000:3.0:1788330505.853405:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788330505.853415:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792510592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788330505.853456:0:22663:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788330505.853473:0:22663:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788330505.862164:0:22663:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788330505.862203:0:22663:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788330505.862329:0:22684:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788330505.862335:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788330505.862359:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.862380:0:22684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.862389:0:22684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.862409:0:22684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.862454:0:22684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.862473:0:22684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 21 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330505.862491:0:22684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792510720:0@lo:104: 00000100:00100000:2.0:1788330505.862595:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330505.862662:0:22684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330505.862670:0:22684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 21 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330505.862679:0:22684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792510848:0@lo:104: 00000100:00100000:2.0:1788330505.862706:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330505.862731:0:22684:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330505.862788:0:22653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788330505.862800:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24171:x1875199792510592:12345-0@lo:253:mount.lustre.0 Request processed in 9386us (9674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330505.862811:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788330505.862824:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792510720 00000100:00100000:1.0:1788330505.862831:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792510720 00000100:00100000:1.0:1788330505.862857:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792510848 00000100:00100000:1.0:1788330505.862860:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792510848 00000100:00100000:1.0:1788330505.862873:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330505.862881:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:22684:x1875199792510720:12345-0@lo:104: 00010000:00010000:1.0:1788330505.862895:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.862955:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330505.862961:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:22684:x1875199792510720:12345-0@lo:104: Request processed in 81us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330505.862967:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330505.862980:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330505.862982:0:22684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792510720:0@lo:104: 00000100:00100000:1.0:1788330505.862992:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefcd87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:22684:x1875199792510848:12345-0@lo:104: 00010000:00010000:1.0:1788330505.863000:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.863042:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788330505.863047:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefcd87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:22684:x1875199792510848:12345-0@lo:104: Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330505.863052:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330505.863096:0:22684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792510848:0@lo:104: 00010000:00010000:2.0:1788330505.863118:0:22684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863212:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330505.863222:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863231:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330505.863236:0:22657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863246:0:22657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330505.863253:0:22657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330505.863260:0:22657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330505.863314:0:22657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863321:0:22657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330505.863354:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863371:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd2a42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a49 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863386:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330505.863389:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863404:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330505.863407:0:22657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863415:0:22657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330505.863421:0:22657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330505.863426:0:22657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788330505.863430:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792510976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330505.863440:0:22657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863446:0:22657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330505.863464:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330505.863472:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330505.863479:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e78000/0x8475908e9fd2a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a3b expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330505.863494:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330505.863495:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330505.863497:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330505.863511:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792511104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330505.863806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330505.864015:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792510976 00000100:00100000:1.0:1788330505.864022:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792510976 00010000:00010000:1.0:1788330505.864045:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 21 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330505.864077:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792511104 00000100:00100000:1.0:1788330505.864080:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792511104 00010000:00010000:1.0:1788330505.864091:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 22 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330505.864192:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330505.864202:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:3649:x1875199792510976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330505.864213:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330505.864218:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 22 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864229:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 22 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864255:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064000/0x8475908e9fd2a49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2a42 expref: 22 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864281:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330505.864320:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3649:x1875199792510976:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330505.864327:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330505.864341:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330505.864347:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd348c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:3646:x1875199792511104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330505.864355:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330505.864359:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 20 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864368:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 20 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864378:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064200/0x8475908e9fd2a3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2a34 expref: 20 pid: 22664 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864388:0:22655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864406:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788330505.864420:0:22655:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007772556s 00010000:00010000:1.0:1788330505.864425:0:22655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864450:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864457:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864463:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864468:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330505.864472:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864487:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864501:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.864509:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330505.864537:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd348c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:3646:x1875199792511104:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330505.864543:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788330505.867597:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330505.867953:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792511104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330505.868069:0:22684:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.868082:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330505.868090:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9039400/0x8475908e9fd2af1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330505.868310:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792510976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330505.869062:0:24171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24171:1875199792510592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330505.869081:0:24171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788330505.869084:0:24171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330505.869086:0:24171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788330505.869087:0:24171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330505.869088:0:24171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330505.869089:0:24171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330505.869090:0:24171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330505.869092:0:24171:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330505.869093:0:24171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330505.869094:0:24171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788330505.869107:0:24171:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788330505.880086:0:24171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788330505.891680:0:24171:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788330505.891691:0:24171:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788330505.891728:0:24171:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788330505.891778:0:24171:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788330505.891797:0:24171:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788330505.891824:0:24171:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788330505.893749:0:24171:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330505.893981:0:24171:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788330506.555819:0:24250:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330506.556054:0:24250:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788330506.719238:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330507.103004:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788330507.236790:0:22666:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788330507.236797:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d04000 from 13 10000000:01000000:3.0:1788330507.236803:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330507.236858:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.236881:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.236893:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330507.236919:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792511232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330507.236989:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330507.237036:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330507.237090:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792511232 00000100:00100000:2.0:1788330507.237100:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792511232 00000100:00100000:2.0:1788330507.237451:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788330507.237462:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+19:22666:x1875199792511232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330507.237477:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330507.237492:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2af8 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330507.237516:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 20 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330507.237526:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 20 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330507.237548:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039800, rc 0) 00000100:00100000:2.0:1788330507.237640:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:22666:x1875199792511232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330507.237647:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788330507.241498:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792511232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330507.241531:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.241544:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330507.241622:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792511360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788330507.241686:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330507.242866:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330507.242972:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792511360 00000100:00100000:0.0:1788330507.242981:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792511360 00000100:00100000:0.0:1788330507.243028:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788330507.243037:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:22666:x1875199792511360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330507.243057:0:22662:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330507.243074:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330507.243077:0:22662:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788330507.243208:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:22666:x1875199792511360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 171us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330507.243215:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788330507.246218:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792511360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788330507.246324:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330507.246335:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.246346:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330507.246368:0:22666:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788330507.246371:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee7213000 from 13 10000000:01000000:3.0:1788330507.246374:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330507.246424:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.246433:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.246445:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330507.246464:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792511488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330507.246526:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330507.246570:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792511488 00000100:00100000:3.0:1788330507.246575:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792511488 00000100:00100000:3.0:1788330507.246613:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788330507.246622:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:22666:x1875199792511488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330507.246636:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330507.246650:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2b06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.246674:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 21 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.246684:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 21 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.246703:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ef400, rc 0) 00000100:00100000:3.0:1788330507.246735:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792511488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330507.246741:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788330507.246783:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788330507.246795:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792511488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330507.246807:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.246815:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330507.246854:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792511616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788330507.246883:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330507.246900:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792511616 00000100:00100000:3.0:1788330507.246903:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792511616 00000100:00100000:3.0:1788330507.246920:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788330507.246925:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792511616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788330507.246938:0:22662:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788330507.246954:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788330507.246957:0:22662:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788330507.247021:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792511616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330507.247028:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788330507.247047:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788330507.247057:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792511616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788330507.247097:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330507.247103:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330507.247110:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330507.740270:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330508.768930:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330509.791608:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330510.238856:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792511744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330510.238927:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330510.239000:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792511744 00000100:00100000:2.0:1788330510.239008:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792511744 00000100:00100000:2.0:1788330510.239054:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788330510.239064:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792511744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330510.239096:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330510.239140:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792511744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330510.239168:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788330510.239217:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792511744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330510.242770:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792511872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330510.242847:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330510.242922:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792511872 00000100:00100000:1.0:1788330510.242931:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792511872 00000100:00100000:1.0:1788330510.242995:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330510.243005:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792511872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330510.243041:0:22673:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788330510.244583:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792511872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1572us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330510.244595:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330510.244682:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792511872:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788330510.811335:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788330511.260741:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330511.260755:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330511.260758:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330511.260760:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330511.260776:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330511.260779:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330511.260781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330511.260794:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330511.260836:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792512128:0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.260907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330511.260950:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792512640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.260974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330511.261004:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788330511.261009:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792512256:0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.261031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330511.261046:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792512768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.261068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330511.261103:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792512128 00000100:00100000:0.0:1788330511.261111:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792512128 00000100:00100000:0.0:1788330511.261180:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330511.261190:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792512128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.261246:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792512128:12345-0@lo:400:kworker.0 Request processed in 57us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330511.261253:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330511.261276:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792512640 00000100:00100000:0.0:1788330511.261280:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792512640 00000100:00100000:0.0:1788330511.261325:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792512256 00000100:00100000:0.0:1788330511.261328:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792512256 00000100:00100000:0.0:1788330511.261339:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792512768 00000100:00100000:0.0:1788330511.261342:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792512768 00000100:00100000:0.0:1788330511.261368:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330511.261374:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792512640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.261404:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792512640:12345-0@lo:400:kworker.0 Request processed in 31us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330511.261417:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330511.261430:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330511.261436:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792512256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.261464:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792512256:12345-0@lo:400:kworker.0 Request processed in 30us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330511.261470:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330511.261480:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330511.261486:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792512768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.261512:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792512768:12345-0@lo:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330511.261517:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788330511.261568:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330511.261572:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788330511.261597:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc65b6a00 x1875199792512256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330511.261610:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792512256:0@lo:400:kworker.0 00010000:00080000:0.0:1788330511.261620:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc65b6680 x1875199792512768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330511.261628:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792512768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.261638:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792512128:0@lo:400:kworker.0 00010000:00080000:0.0:1788330511.261646:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc65b4a80 x1875199792512640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330511.261654:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792512640:0@lo:400:kworker.0 00000100:00100000:2.0:1788330511.263926:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792512000:0@lo:400:kworker.0 00000100:00100000:2.0:1788330511.264007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330511.264060:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792512512:0@lo:400:kworker.0 00000100:00100000:2.0:1788330511.264088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330511.264114:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330511.264121:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792512384:0@lo:400:kworker.0 00000100:00100000:2.0:1788330511.264148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330511.264696:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792512000 00000100:00100000:0.0:1788330511.264716:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792512000 00000100:00100000:0.0:1788330511.264777:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788330511.264788:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3649:x1875199792512000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.264846:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3649:x1875199792512000:12345-0@lo:400:kworker.0 Request processed in 60us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330511.264853:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788330511.264898:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792512512 00000100:00100000:0.0:1788330511.264902:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792512512 00000100:00100000:0.0:1788330511.264928:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330511.264934:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792512512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330511.264966:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792512512:12345-0@lo:400:kworker.0 Request processed in 32us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330511.264972:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330511.265209:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792512000:0@lo:400:kworker.0 00010000:00080000:2.0:1788330511.265246:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc65b5180 x1875199792512512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330511.265257:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792512512:0@lo:400:kworker.0 00000100:00100000:1.0:1788330511.267065:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792512384 00000100:00100000:1.0:1788330511.267079:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792512384 00000100:00100000:1.0:1788330511.267134:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330511.267143:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792512384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330511.267253:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792512384:12345-0@lo:400:kworker.0 Request processed in 111us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330511.267260:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330511.270229:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792512384:0@lo:400:kworker.0 00000040:00080000:3.0:1788330511.323812:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330511.837651:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788330511.960657:0:24540:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788330512.859374:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788330513.266068:0:24593:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330513.266673:0:24593:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788330513.886437:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788330514.368486:0:24643:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330514.368767:0:24643:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330514.908469:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330515.100217:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330500/real 1788330500] req@ffff99edc7697480 x1875199792505984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330515.100306:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc7697480 x1875199792505984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330515.100354:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330500/real 1788330500] req@ffff99edc7697100 x1875199792506112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330515.100369:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc7697100 x1875199792506112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330515.100395:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f30800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330515.100434:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788330515.100439:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792505984:0@lo:8:kworker.0 00000100:00080000:1.0:1788330515.100446:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330515.100452:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788330515.100456:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792506112:0@lo:8:kworker.0 00000100:00080000:2.0:1788330515.101219:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330515.101225:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330515.101228:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330515.101231:0:23217:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788330515.101270:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792513152:0@lo:400:kworker.0 00000100:00100000:2.0:1788330515.101389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330515.101483:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792513152 00000100:00100000:2.0:1788330515.101494:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792513152 00000100:00100000:2.0:1788330515.101552:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330515.101563:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792513152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330515.101626:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792513152:12345-0@lo:400:kworker.0 Request processed in 64us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330515.101635:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788330515.101683:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7694000 x1875199792513152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330515.101698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792513152:0@lo:400:kworker.0 00000100:00080000:2.0:1788330515.101747:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330515.101751:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788330515.101755:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99edc5f30800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330515.101761:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 703 00000100:00080000:2.0:1788330515.101767:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788330515.101772:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99edc5f30800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330515.101781:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792513280:0@lo:400:kworker.0 00000100:00100000:2.0:1788330515.101818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330515.101876:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7696300 x1875199792513408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330515.101888:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330515.101892:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788330515.101894:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330515.101898:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 703 00000100:00080000:2.0:1788330515.101900:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788330515.101904:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99eeffa6f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330515.101916:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7694700 x1875199792513536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330515.101962:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792513920:0@lo:400:kworker.0 00000100:00100000:2.0:1788330515.101998:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330515.102058:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792513280 00000100:00100000:2.0:1788330515.102062:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792513280 00000100:00100000:2.0:1788330515.102096:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788330515.102103:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792513280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330515.102195:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792513280:12345-0@lo:400:kworker.0 Request processed in 92us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330515.102203:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788330515.102252:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792513280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103002:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792513024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103078:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330515.103136:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792513792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103189:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330515.103213:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788330515.103220:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792512896:0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103250:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330515.103274:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792513664:0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330515.103351:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792513920 00000100:00100000:0.0:1788330515.103371:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792513920 00000100:00100000:0.0:1788330515.103418:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792513792 00000100:00100000:0.0:1788330515.103422:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792513792 00000100:00100000:0.0:1788330515.103436:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792513664 00000100:00100000:0.0:1788330515.103439:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792513664 00000100:00100000:0.0:1788330515.103456:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788330515.103465:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792513920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103531:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792513920:12345-0@lo:400:kworker.0 Request processed in 67us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330515.103538:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788330515.103557:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788330515.103564:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792513792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103597:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792513792:12345-0@lo:400:kworker.0 Request processed in 34us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330515.103603:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788330515.103614:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330515.103620:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792513664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103647:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792513664:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330515.103652:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788330515.103674:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330515.103680:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788330515.103708:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7696a00 x1875199792513664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330515.103721:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792513664:0@lo:400:kworker.0 00010000:00080000:0.0:1788330515.103731:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7694e00 x1875199792513792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330515.103751:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792513792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103798:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792512896 00000100:00100000:0.0:1788330515.103802:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792512896 00000100:00100000:0.0:1788330515.103830:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788330515.103837:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3649:x1875199792512896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330515.103871:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3649:x1875199792512896:12345-0@lo:400:kworker.0 Request processed in 35us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330515.103878:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788330515.103915:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792512896:0@lo:400:kworker.0 00000100:00100000:1.0:1788330515.104047:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792513408:0@lo:8:kworker.0 00000100:00100000:1.0:1788330515.104089:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330515.104118:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792513536:0@lo:8:kworker.0 00000100:00100000:1.0:1788330515.104195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330515.107620:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792513024 00000100:00100000:2.0:1788330515.107647:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792513024 00000100:00100000:2.0:1788330515.108380:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330515.108396:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792513024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330515.108562:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792513024:12345-0@lo:400:kworker.0 Request processed in 170us (5483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330515.108572:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330515.108619:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792513408 00000100:00100000:2.0:1788330515.108626:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792513408 00000100:00100000:2.0:1788330515.108648:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792513536 00000100:00100000:2.0:1788330515.108651:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792513536 00000100:00100000:2.0:1788330515.108661:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330515.108667:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792513408:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788330515.108715:0:24177:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1788330515.108755:0:24177:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd2b14 00002000:00100000:2.0:1788330515.108774:0:24177:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99eefddeb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788330515.108780:0:24177:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788330515.108783:0:24177:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788330515.109083:0:24177:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788330515.109118:0:24177:0:(import.c:65:import_set_state_nolock()) ffff99eefddea800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330515.109192:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792513408:12345-0@lo:8:kworker.0 Request processed in 523us (5102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330515.109220:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330515.109234:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330515.109238:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792513536:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788330515.109253:0:24177:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788330515.110483:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7697b80 x1875199792513920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330515.110504:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792513920:0@lo:400:kworker.0 00010000:00080000:1.0:1788330515.111092:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7696300 x1875199792513408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330515.111105:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788330515.111115:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788330515.111128:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788330515.111138:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788330515.111200:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f30800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788330515.111233:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788330515.111241:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792513408:0@lo:8:kworker.0 00000004:00080000:0.0:1788330515.112439:0:23411:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788330515.112489:0:23411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23411:1875199792514176:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788330515.112577:0:23411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330515.112615:0:23411:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920c3c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788330515.112640:0:23410:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788330515.112797:0:23410:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 719084646007ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788330515.112806:0:23410:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788330515.112872:0:24176:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788330515.112882:0:24176:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788330515.113011:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330515.113344:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792514048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330515.113390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330515.113466:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792514176 00000100:00100000:0.0:1788330515.113475:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792514176 00000100:00080000:0.0:1788330515.113548:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330515.113936:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330515.113954:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23411:x1875199792514176:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788330515.116077:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792514048 00000100:00100000:3.0:1788330515.116099:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792514048 00000100:00100000:3.0:1788330515.116333:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330515.116347:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875199792514048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330515.116392:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788330515.116530:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875199792514048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (3139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330515.116538:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788330515.116616:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc65b6a00 x1875199792514048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330515.116642:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792514048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330515.116718:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792513024:0@lo:400:kworker.0 00000004:00080000:0.0:1788330515.126514:0:23402:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788330515.146874:0:24662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788330515.146887:0:24662:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788330515.147035:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23411:x1875199792514176:12345-0@lo:7:osp-pre-0-1.0 Request processed in 33081us (34451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330515.147054:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788330515.150407:0:23411:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc65b4380 x1875199792514176/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788330531 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330515.150436:0:23411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23411:1875199792514176:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788330515.150458:0:23411:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788330515.150530:0:23411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23411:1875199792514304:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788330515.150621:0:23411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330515.150693:0:23411:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330515.151009:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792514304 00000100:00100000:1.0:1788330515.151019:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792514304 00000100:00100000:1.0:1788330515.151096:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330515.151110:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23411:x1875199792514304:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788330515.151191:0:24176:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788330515.151245:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23411:x1875199792514304:12345-0@lo:5:osp-pre-0-1.0 Request processed in 138us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330515.151254:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788330515.152230:0:23411:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc65b4380 x1875199792514304/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330531 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330515.152250:0:23411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23411:1875199792514304:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788330515.152268:0:23411:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788330515.152454:0:23411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23411:1875199792514432:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788330515.152513:0:23411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330515.152552:0:23411:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8609b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330515.152928:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792514432 00000100:00100000:0.0:1788330515.152937:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792514432 00000100:00100000:0.0:1788330515.152998:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330515.153008:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23411:x1875199792514432:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788330515.153237:0:24662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788330515.159808:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792513536:12345-0@lo:8:kworker.0 Request processed in 50554us (55598us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788330515.159831:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788330515.159943:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330515.159950:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788330515.159956:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792513536:0@lo:8:kworker.0 00000001:00080000:1.0:1788330515.197067:0:24172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788330515.197093:0:24172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788330515.197405:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23411:x1875199792514432:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44390us (44884us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788330515.197436:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788330515.197436:0:23411:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eed82d3100 x1875199792514432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330531 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330515.197449:0:23411:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788330515.197457:0:23411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23411:1875199792514432:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788330515.197476:0:23411:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788330515.197548:0:23411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23411:1875199792514560:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788330515.197609:0:23411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330515.197646:0:23411:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8609b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330515.197798:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792514560 00000100:00100000:3.0:1788330515.197808:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792514560 00000100:00100000:3.0:1788330515.197956:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330515.197970:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23411:x1875199792514560:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788330515.198407:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23411:x1875199792514560:12345-0@lo:900:osp-pre-0-1.0 Request processed in 438us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330515.198416:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788330515.199483:0:23411:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eed82d3100 x1875199792514560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330531 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330515.199504:0:23411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23411:1875199792514560:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788330515.359303:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330515.359348:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792514688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330515.359459:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330515.359535:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792514688 00000100:00100000:2.0:1788330515.359544:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792514688 00000100:00100000:2.0:1788330515.359615:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330515.359627:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792514688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330515.359700:0:22673:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330515.359757:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792514688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330515.359765:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330515.359832:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792514688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330515.360093:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792514816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330515.360129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330515.360339:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792514816 00000100:00100000:1.0:1788330515.360345:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792514816 00000100:00100000:1.0:1788330515.360385:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788330515.360394:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792514816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330515.360418:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788330515.360508:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792514816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330515.360516:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788330515.370073:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792514816:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788330515.937682:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330516.955405:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330517.348030:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330517.981973:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330519.004225:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330520.028422:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788330520.475718:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330520.475738:0:13408:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330520.475741:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330520.475744:0:13408:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330520.475787:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330520.475791:0:13408:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788330520.475796:0:13408:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330520.475807:0:13408:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 719 00000100:00080000:2.0:1788330520.475815:0:13408:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788330520.475824:0:13408:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99eeffa6f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330520.475854:0:13408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72ffb80 x1875199792515584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330520.475917:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792515072:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330520.476063:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792515712:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330520.476124:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788330520.476131:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3647:1875199792514944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330520.476210:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792515456:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330520.476292:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792515200:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330520.476351:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792515840:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476396:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330520.476415:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788330520.476421:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792515328:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330520.476464:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792515968:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330520.476517:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792515072 00000100:00100000:2.0:1788330520.476526:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792515072 00000100:00100000:2.0:1788330520.476578:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792515328 00000100:00100000:2.0:1788330520.476581:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792515328 00000100:00100000:2.0:1788330520.476600:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788330520.476609:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792515072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476673:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792515072:12345-0@lo:400:kworker.0 Request processed in 64us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330520.476680:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788330520.476702:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788330520.476709:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792515328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476741:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792515328:12345-0@lo:400:kworker.0 Request processed in 33us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330520.476747:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788330520.476764:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792515712 00000100:00100000:2.0:1788330520.476769:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792515712 00000100:00100000:2.0:1788330520.476787:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792515200 00000100:00100000:2.0:1788330520.476789:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792515200 00000100:00100000:2.0:1788330520.476799:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792515840 00000100:00100000:2.0:1788330520.476801:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792515840 00000100:00100000:2.0:1788330520.476825:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792515968 00000100:00100000:2.0:1788330520.476827:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792515968 00000100:00100000:2.0:1788330520.476857:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788330520.476863:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792515712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476895:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792515712:12345-0@lo:400:kworker.0 Request processed in 32us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330520.476901:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788330520.476914:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788330520.476920:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792515200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476947:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792515200:12345-0@lo:400:kworker.0 Request processed in 28us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330520.476953:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788330520.476964:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788330520.476970:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792515840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.476997:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792515840:12345-0@lo:400:kworker.0 Request processed in 27us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330520.477003:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788330520.477014:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330520.477021:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792515968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.477046:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792515968:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330520.477052:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330520.477072:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792514944 00000100:00100000:2.0:1788330520.477075:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792514944 00000100:00100000:2.0:1788330520.477102:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788330520.477109:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3647:x1875199792514944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.477140:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3647:x1875199792514944:12345-0@lo:400:kworker.0 Request processed in 31us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330520.477182:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788330520.477219:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792515456 00000100:00100000:2.0:1788330520.477223:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792515456 00000100:00100000:2.0:1788330520.477252:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330520.477271:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792515456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.477305:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792515456:12345-0@lo:400:kworker.0 Request processed in 47us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330520.477310:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330520.477361:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3647:1875199792514944:0@lo:400:kworker.0 00010000:00080000:2.0:1788330520.477376:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc72ff100 x1875199792515456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330520.477389:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792515456:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.477400:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792515072:0@lo:400:kworker.0 00010000:00080000:2.0:1788330520.477410:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7694700 x1875199792515712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330520.477418:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792515712:0@lo:400:kworker.0 00000100:00100000:2.0:1788330520.477455:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792515328:0@lo:400:kworker.0 00010000:00080000:2.0:1788330520.477465:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7696300 x1875199792515968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330520.477473:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792515968:0@lo:400:kworker.0 00010000:00080000:2.0:1788330520.477481:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc72fd180 x1875199792515200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330520.477503:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792515200:0@lo:400:kworker.0 00010000:00080000:2.0:1788330520.477516:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7697800 x1875199792515840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330520.477524:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792515840:0@lo:400:kworker.0 00000100:00080000:2.0:1788330520.477548:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330520.477554:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330520.477556:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330520.478513:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792516224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330520.478583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330520.478620:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330520.478627:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792516096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330520.478652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330520.478690:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792516224 00000100:00100000:0.0:1788330520.478696:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792516224 00000100:00100000:0.0:1788330520.478740:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792516096 00000100:00100000:0.0:1788330520.478743:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792516096 00000100:00100000:0.0:1788330520.478759:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788330520.478768:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792516224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330520.478811:0:22674:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788330520.478857:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792516224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330520.478864:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788330520.478883:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330520.478889:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792516096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330520.478907:0:22674:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330520.478934:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792516096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330520.478940:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330520.478985:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792516096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330520.478997:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792516224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330520.479721:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792515584:0@lo:8:kworker.0 00000100:00100000:3.0:1788330520.479777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330520.479856:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792516352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330520.479886:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330520.479935:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792516352 00000100:00100000:3.0:1788330520.479942:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792516352 00000100:00100000:3.0:1788330520.479982:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330520.479990:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792516352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330520.480015:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788330520.480054:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792516352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330520.480060:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788330520.480096:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eec995f100 x1875199792516352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330520.480112:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792516352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330520.480679:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792515584 00000100:00100000:2.0:1788330520.480685:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792515584 00000100:00100000:2.0:1788330520.481793:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330520.481805:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792515584:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788330520.481911:0:24177:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788330520.482201:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792515584:12345-0@lo:8:kworker.0 Request processed in 396us (2421us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788330520.482211:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788330520.482491:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330520.482498:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788330520.482503:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792515584:0@lo:8:kworker.0 00010000:00010000:3.0:1788330521.051845:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330521.511606:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330501/real 1788330501] req@ffff99eeffc9aa00 x1875199792506880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330521.511683:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eeffc9aa00 x1875199792506880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330521.515126:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330501/real 1788330501] req@ffff99eeffc9b800 x1875199792507008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330521.515189:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eeffc9b800 x1875199792507008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330521.515220:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eef59c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330521.515261:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330521.515266:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792506880:0@lo:8:kworker.0 00000100:00080000:3.0:1788330521.515274:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330521.515280:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330521.515294:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792507008:0@lo:8:kworker.0 00000100:00100000:3.0:1788330521.515409:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792516480:0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.515501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.515588:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792516480 00000100:00100000:3.0:1788330521.515598:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792516480 00000100:00100000:3.0:1788330521.515659:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788330521.515670:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3649:x1875199792516480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.515731:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3649:x1875199792516480:12345-0@lo:400:kworker.0 Request processed in 62us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330521.515740:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788330521.515801:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792516480:0@lo:400:kworker.0 00000100:00080000:3.0:1788330521.515859:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330521.515865:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788330521.515868:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99eef59c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330521.515874:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 704 00000100:00080000:3.0:1788330521.515880:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788330521.515885:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99eef59c0000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330521.515897:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792516608:0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.515932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.515975:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792516608 00000100:00100000:3.0:1788330521.515979:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792516608 00000100:00100000:3.0:1788330521.516011:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788330521.516018:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792516608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.516061:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792516608:12345-0@lo:400:kworker.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330521.516067:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788330521.516097:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792516608:0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.516131:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eec995f100 x1875199792516736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330521.516148:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330521.516174:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788330521.516176:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330521.516180:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 704 00000100:00080000:3.0:1788330521.516183:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788330521.516187:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99edc7d06800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330521.516206:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792516736:0@lo:8:kworker.0 00000100:00100000:3.0:1788330521.516236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.516282:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792516736 00000100:00100000:3.0:1788330521.516286:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792516736 00000100:00100000:3.0:1788330521.516309:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330521.516315:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792516736:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788330521.516348:0:24178:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:3.0:1788330521.516387:0:24178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd2b1b 00002000:00100000:3.0:1788330521.516407:0:24178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99edc84a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788330521.516412:0:24178:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788330521.516416:0:24178:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788330521.516518:0:24178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788330521.516548:0:24178:0:(import.c:65:import_set_state_nolock()) ffff99edc84a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330521.516591:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792516736:12345-0@lo:8:kworker.0 Request processed in 275us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330521.516599:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788330521.516631:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eec995f100 x1875199792516736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330521.516640:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330521.516648:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788330521.516656:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788330521.516661:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788330521.516664:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eef59c0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788330521.516677:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788330521.516682:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792516736:0@lo:8:kworker.0 00000004:00080000:3.0:1788330521.516724:0:22693:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788330521.516751:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22693:1875199792516992:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788330521.516778:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.516796:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717240 going to sleep for 11 seconds 00000004:00080000:3.0:1788330521.516813:0:22692:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788330521.516895:0:22692:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725488743282ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788330521.516903:0:22692:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788330521.516934:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792516992 00000100:00100000:3.0:1788330521.516939:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792516992 00000100:00100000:3.0:1788330521.516979:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330521.516986:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22693:x1875199792516992:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788330521.517453:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330521.517476:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792516864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330521.517520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.517562:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792516864 00000100:00100000:3.0:1788330521.517567:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792516864 00000100:00100000:3.0:1788330521.517602:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330521.517610:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792516864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330521.517628:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788330521.517670:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792516864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330521.517677:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788330521.517715:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eec995f100 x1875199792516864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330521.517734:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792516864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330521.517774:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eec995f100 x1875199792517120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330521.517814:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792517120:0@lo:8:kworker.0 00000100:00100000:3.0:1788330521.517842:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.517870:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792517120 00000100:00100000:3.0:1788330521.517874:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792517120 00000100:00100000:3.0:1788330521.517894:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330521.517899:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792517120:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788330521.517922:0:24178:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788330521.517956:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792517120:12345-0@lo:8:kworker.0 Request processed in 55us (113us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788330521.517963:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788330521.517992:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330521.517997:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788330521.518001:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792517120:0@lo:8:kworker.0 00000100:00100000:3.0:1788330521.518042:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792517248:0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.518074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.518128:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792517376:0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.518181:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.518216:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792517376 00000100:00100000:3.0:1788330521.518221:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792517376 00000100:00100000:2.0:1788330521.518526:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792517248 00000100:00100000:2.0:1788330521.518531:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792517248 00000100:00100000:2.0:1788330521.518566:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788330521.518574:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792517248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330521.518614:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792517248:12345-0@lo:400:kworker.0 Request processed in 42us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330521.518620:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788330521.521968:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eec995f100 x1875199792517248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330521.521997:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792517248:0@lo:400:kworker.0 00000100:00080000:2.0:1788330521.522474:0:23217:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330521.522482:0:23217:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788330521.522487:0:23217:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330521.522493:0:23217:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 724 00000100:00080000:2.0:1788330521.522498:0:23217:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788330521.522506:0:23217:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99eeffa6f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330521.522541:0:23217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7696300 x1875199792517632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330521.522714:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792517888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330521.522810:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330521.522875:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792517888 00000100:00100000:2.0:1788330521.522884:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792517888 00000100:00100000:2.0:1788330521.522940:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788330521.522951:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792517888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330521.523015:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792517888:12345-0@lo:400:kworker.0 Request processed in 64us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330521.523023:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788330521.523064:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eec995f100 x1875199792517888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330521.523075:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792517888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330521.523109:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330521.523114:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792518016:0@lo:400:kworker.0 00000100:00100000:1.0:1788330521.523283:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792517504:0@lo:400:kworker.0 00000100:00100000:1.0:1788330521.523333:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330521.523359:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330521.523364:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792517760:0@lo:400:kworker.0 00000100:00100000:1.0:1788330521.523389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330521.524310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.524582:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792517504 00000100:00100000:3.0:1788330521.524591:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792517504 00000100:00100000:3.0:1788330521.524641:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330521.524651:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792517504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.524713:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792517504:12345-0@lo:400:kworker.0 Request processed in 64us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330521.524739:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330521.524773:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330521.524784:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792517376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.524829:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792517376:12345-0@lo:400:kworker.0 Request processed in 48us (6647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330521.524835:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788330521.525061:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7697800 x1875199792517504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330521.525078:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792517504:0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.525115:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792517376:0@lo:400:kworker.0 00000100:00100000:3.0:1788330521.526046:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792517632:0@lo:8:kworker.0 00000100:00100000:3.0:1788330521.526108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.526186:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792517632 00000100:00100000:3.0:1788330521.526194:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792517632 00000100:00100000:3.0:1788330521.526274:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330521.526283:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792517632:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788330521.526307:0:24176:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788330521.526348:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792517632:12345-0@lo:8:kworker.0 Request processed in 64us (239us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788330521.526356:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00002000:00080000:3.0:1788330521.526410:0:24177:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788330521.526418:0:24177:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1788330521.526423:0:24177:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000100:00100000:1.0:1788330521.535235:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792517760 00000100:00100000:1.0:1788330521.535293:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792517760 00000100:00100000:1.0:1788330521.535396:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792518016 00000100:00100000:1.0:1788330521.535400:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792518016 00000100:00100000:1.0:1788330521.535430:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330521.535444:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792517760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330521.535595:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792517760:12345-0@lo:400:kworker.0 Request processed in 154us (12204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330521.535604:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330521.535623:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330521.535631:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792518016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330521.535671:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792518016:12345-0@lo:400:kworker.0 Request processed in 42us (11362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330521.535677:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788330521.536195:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc72fd180 x1875199792518016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330521.536230:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792518016:0@lo:400:kworker.0 00000100:00080000:2.0:1788330521.538558:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330521.538577:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788330521.538584:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792517632:0@lo:8:kworker.0 00000004:00080000:0.0:1788330521.545411:0:22649:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:3.0:1788330521.546856:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7694700 x1875199792517760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330521.546895:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792517760:0@lo:400:kworker.0 00002000:00010000:3.0:1788330521.547743:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.547757:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547780:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.547786:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.547794:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547819:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547832:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547840:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547864:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330521.547880:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330521.547887:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547895:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330521.547900:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547918:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547939:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547947:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2b22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.547965:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.547967:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.547969:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.548742:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.548754:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.548766:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.548770:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.548774:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.548786:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.548794:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.548808:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.548828:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330521.551107:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.551123:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.551143:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.551373:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.551384:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.551405:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.551416:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.551425:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.551494:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788330521.552138:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.552147:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.552396:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.552400:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.552405:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.552417:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.552426:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.552434:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554755:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788330521.554776:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554793:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.554799:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554812:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554846:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554855:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2b29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554886:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330521.554890:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554910:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.554913:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554921:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554932:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554940:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2b30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554953:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.554957:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554964:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eee00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.554967:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554975:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554983:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.554997:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.554999:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.555001:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.557427:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788330521.557447:0:24177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.557927:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.558478:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.558491:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.558512:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.558517:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.558525:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.558557:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.558569:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.558577:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.558600:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.558797:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.558805:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.558815:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.558821:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.558831:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.558851:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.558859:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6da3c8d/0x8475908e9fd2b3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.558877:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.558879:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.558881:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.561590:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.561619:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561642:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.561648:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.561656:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561673:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561686:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561709:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561738:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330521.561753:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330521.561759:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561767:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330521.561773:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561783:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561803:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561810:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2b45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.561831:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.561832:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.561834:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.562633:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.562653:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.562665:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.562669:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.562674:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.562685:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.562693:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.562701:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.562726:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.562882:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.562890:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.562905:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.562910:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.562920:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.562935:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.562943:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd2b4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.562962:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.562963:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.562965:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.563112:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.563118:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.563126:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.563129:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.563134:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.563143:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.563185:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.563454:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.563480:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.563631:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.563637:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.563644:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.563647:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.563654:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.563674:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.563681:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd2b53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.563698:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.563701:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.563703:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.563983:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.563989:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.563999:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.564002:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.564007:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.564018:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.564025:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.564033:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.564067:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330521.565146:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.565180:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.565370:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.565376:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.565382:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.565399:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.565408:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.565416:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.565431:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788330521.566274:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330521.566288:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.566302:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330521.566308:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.566318:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.566347:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.566371:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d5cb267/0x8475908e9fd2b5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575088:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.575107:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575127:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7efc00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.575133:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330521.575138:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330521.575178:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.575184:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.575203:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.575208:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.575216:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.575236:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.575258:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.575268:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.575311:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.575407:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575418:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a2042f6/0x8475908e9fd2b61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575460:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.575465:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575472:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.575476:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575484:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575494:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575501:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2b68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.575520:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.575522:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.575524:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.575532:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.575535:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.575537:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330521.577543:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330521.577560:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.577576:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.577580:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.577586:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.577612:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.577623:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.577631:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.577658:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.578205:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.578215:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.578239:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.578245:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.578262:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.578284:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.578293:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.578322:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.578324:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.578327:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.579425:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.579439:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.579453:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.579465:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.579473:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.579487:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.579510:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.579518:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.579542:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.579905:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.579913:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.579923:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eee00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.579927:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.579937:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.579963:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.579972:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd2b76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.579993:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.579996:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.579998:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330521.581381:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330521.581399:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.581418:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.581423:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.581430:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.581446:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.581456:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.581482:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.581514:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.581692:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.581699:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.581711:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.581716:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.581726:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.581745:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.581752:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd2b7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.581786:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.581788:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.581790:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330521.582600:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330521.582613:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.582628:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.582632:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.582638:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.582651:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.582660:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.582668:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.582692:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.583212:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.583220:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583232:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.583237:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583256:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583278:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583286:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d146e1e/0x8475908e9fd2b84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583315:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.583318:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.583320:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330521.583623:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330521.583632:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.583651:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.583655:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.583660:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.583672:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.583680:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.583688:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.583711:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.583772:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.583778:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583799:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.583803:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583811:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583824:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583831:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a41a2b1/0x8475908e9fd2b8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.583847:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.583849:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.583852:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330521.584075:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330521.584081:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.584089:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.584093:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.584097:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.584107:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.584143:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.584182:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.584197:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.584307:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.584314:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.584322:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.584326:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.584335:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.584356:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.584363:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f769168/0x8475908e9fd2b92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.584379:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.584381:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.584383:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330521.586649:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330521.586668:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.586689:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.586694:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.586701:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.586717:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.586727:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.586734:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.586781:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.587700:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.587712:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.587725:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.587732:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.587743:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.587768:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.587776:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016983baa/0x8475908e9fd2b99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.587819:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.587822:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.587824:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330521.588745:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330521.588761:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.588775:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.588779:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.588786:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.588800:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.588809:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.588818:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.588890:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788330521.590512:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330521.590528:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.590546:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1788330521.590560:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330521.590567:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.590586:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.590597:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.590605:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590731:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330521.590743:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590753:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330521.590759:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590769:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590790:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590798:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd2ba0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590821:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330521.590825:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590832:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330521.590842:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590851:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590874:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.590882:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330521.590884:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330521.590886:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330521.596021:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788330521.596045:0:24177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074d511af/0x8475908e9fd2ba7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.596096:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330521.600562:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330521.600582:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.600605:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1788330521.600610:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330521.600618:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.600636:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.600649:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.600659:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.600692:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.602359:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.602376:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602393:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.602399:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602411:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330521.602413:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330521.602429:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602443:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.602444:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1788330521.602453:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330521.602462:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d149c57f/0x8475908e9fd2bae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.602465:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.602489:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602498:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330521.602498:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602502:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.602506:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330521.602512:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.602542:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.602669:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.602675:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602697:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.602701:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602709:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602721:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602728:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db545e03/0x8475908e9fd2bb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.602743:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.602745:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.602748:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330521.604245:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330521.604270:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.606227:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1788330521.606264:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330521.606276:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.606308:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.606323:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.606332:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.606369:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.606401:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.606410:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.606418:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.606422:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.606431:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.606459:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.606465:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011996a8/0x8475908e9fd2bbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.606494:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.606495:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.606496:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330521.608235:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330521.608260:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.608279:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1788330521.608283:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330521.608289:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.608304:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.608314:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.608331:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.608348:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330521.608446:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.608455:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.608465:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ae00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.608470:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.608480:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.608501:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.608511:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ddce7e/0x8475908e9fd2bc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.608548:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.608550:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.608553:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330521.609845:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330521.609859:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.609877:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1788330521.609882:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330521.609888:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.609902:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.609912:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.609920:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.609947:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330521.611676:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330521.611694:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.611710:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330521.611715:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.611727:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.611754:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.611771:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d22f8b8/0x8475908e9fd2bca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.611798:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.611799:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.611801:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330521.612477:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330521.612490:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.612510:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1788330521.612515:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330521.612522:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.612537:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.612546:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.612555:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.612621:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788330521.615291:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330521.615310:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.615332:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1788330521.615337:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330521.615345:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.615361:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.615388:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.615397:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.615889:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330521.615900:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.615911:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330521.615918:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.615928:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.615966:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.615976:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8af917b/0x8475908e9fd2bd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.615997:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330521.616002:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.616008:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb93c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330521.616012:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.616020:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.616031:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.616040:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330521.616041:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330521.616043:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330521.617760:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788330521.617782:0:24177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e7c6ec0/0x8475908e9fd2bd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.618241:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330521.622540:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330521.622562:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.622587:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1788330521.622594:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330521.622603:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.622624:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.622638:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.622661:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330521.622702:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330521.623048:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330521.623059:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.623070:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb93400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330521.623077:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.623088:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.623112:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.623120:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8dc029d/0x8475908e9fd2bdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.623142:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.623144:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330521.623146:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.628733:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.628753:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.628776:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.628781:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.628790:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.628807:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.628818:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.628827:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.628853:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1788330521.629801:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330521.629995:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330521.630008:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.630021:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.630027:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.630039:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.630069:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.630078:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd2be6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.630101:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.630103:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.630105:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.632897:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.632919:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.632944:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.632951:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.632960:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.633004:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.633016:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.633025:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.633056:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330521.634684:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.634704:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.634723:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.634728:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.634735:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.634751:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.634761:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.634783:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.634814:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788330521.635115:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330521.635281:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635298:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330521.635304:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635314:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635339:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635348:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c879b9e4/0x8475908e9fd2bed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635372:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330521.635377:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635383:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330521.635387:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635395:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635404:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635419:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd2bf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330521.635433:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330521.635435:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330521.635437:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330521.635576:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330521.635583:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.635594:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1788330521.635597:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330521.635602:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.635613:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.635621:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.635629:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330521.635651:0:24177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788330521.635961:0:24177:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788330521.636105:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22693:x1875199792516992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 119111us (119317us total) trans 0 rc 0/0 00010000:00010000:2.0:1788330521.636630:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330521.636638:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.636643:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.636663:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eea00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330521.636668:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.636677:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.636697:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.636706:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2bfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330521.636729:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.636731:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330521.636733:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330521.638432:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330521.638558:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22693:1875199792516992:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788330521.638586:0:22693:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788330521.638652:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22693:1875199792518144:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788330521.638738:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330521.638793:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330521.638824:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792518144 00000100:00100000:3.0:1788330521.638833:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792518144 00000100:00100000:3.0:1788330521.638903:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330521.638915:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22693:x1875199792518144:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788330521.638969:0:24176:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1788330521.670070:0:24172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788330521.670171:0:24172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788330521.670431:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22693:x1875199792518144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 31510us (31684us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788330521.670446:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330521.670673:0:22693:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788330521.670685:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22693:1875199792518144:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788330521.670705:0:22693:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1788330522.075378:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788330522.603816:0:24989:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788330522.603822:0:24989:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788330522.603824:0:24989:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788330522.603957:0:24989:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99edc7c0d800 00000020:01000004:2.0:1788330522.603979:0:24989:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788330522.604543:0:24989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788330522.604567:0:24989:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99eeffb64d28) 00000020:00000080:2.0:1788330522.604595:0:24989:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788330522.667544:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788330522.676983:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788330522.677495:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788330522.678365:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788330522.681275:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788330522.683002:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788330522.683433:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788330522.685902:0:24989:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788330522.686126:0:24989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788330522.686143:0:24989:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788330522.686186:0:24989:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8475908e9fd2c09 00000020:01000004:3.0:1788330522.686194:0:24989:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788330522.686216:0:24989:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788330522.686219:0:24989:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788330522.686245:0:24989:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788330522.686281:0:24989:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788330522.686296:0:24989:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788330522.705065:0:24989:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788330522.705105:0:24989:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.150@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788330522.705108:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788330522.705110:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330522.705111:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330522.705112:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330522.705113:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330522.705114:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330522.705115:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330522.705116:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330522.705117:0:24989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330522.705121:0:24989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788330522.705123:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788330522.705123:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330522.705124:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330522.705125:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330522.705125:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330522.705126:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330522.705127:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330522.705128:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330522.705128:0:24989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330522.705194:0:24989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788330522.705216:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788330522.705363:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330522.705420:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788330522.705498:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792518272 00000100:00100000:2.0:1788330522.705507:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792518272 00000100:00100000:2.0:1788330522.705601:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788330522.705613:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24989:x1875199792518272:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788330522.705644:0:22663:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788330522.705647:0:22663:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788330522.705652:0:22663:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788330522.706192:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24989:x1875199792518272:12345-0@lo:253:mount.lustre.0 Request processed in 579us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.706201:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788330522.706339:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788330522.706351:0:24989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788330522.706354:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788330522.706356:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788330522.706357:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330522.706358:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330522.706359:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330522.706360:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330522.706362:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330522.706363:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330522.706364:0:24989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788330522.706387:0:24989:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99edc7c0d800 from lustre-OST0001 10000000:01000000:0.0:1788330522.706419:0:24989:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788330522.706422:0:24989:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788330522.706432:0:24989:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99eec8bb4d28 local copy 00010000:00010000:0.0:1788330522.706443:0:24989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330522.706551:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330522.706583:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330522.706947:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792518400 00000100:00100000:3.0:1788330522.706953:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792518400 00000100:00100000:1.0:1788330522.709692:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788330522.709711:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24989:x1875199792518400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330522.709855:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24989:x1875199792518400:12345-0@lo:501:mount.lustre.0 Request processed in 148us (3270us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788330522.709863:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788330522.709967:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed3787240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330522.710007:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518400:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788330522.710042:0:24989:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788330522.710071:0:24989:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788330522.710081:0:24989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.710092:0:24989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd283c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2843 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330522.710129:0:24989:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99edc7c0d800 10000000:01000000:0.0:1788330522.710135:0:24989:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788330522.710140:0:24989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788330522.710142:0:24989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330522.710147:0:24989:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788330522.710167:0:24989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788330522.710197:0:24989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd2c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.710205:0:24989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd2c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.710214:0:24989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd2c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330522.710234:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330522.710289:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330522.711190:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed3787240 going to sleep for 11 seconds 00000100:00100000:2.0:1788330522.711467:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792518528 00000100:00100000:2.0:1788330522.711476:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792518528 00000100:00100000:0.0:1788330522.711576:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788330522.711585:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:24989:x1875199792518528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330522.711610:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330522.711626:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd2c17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2c10 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.711653:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd2c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2c10 expref: 22 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.711664:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd2c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2c10 expref: 22 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.711672:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79e00, rc 0) 00000100:00100000:0.0:1788330522.711742:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792518528:12345-0@lo:101:mount.lustre.0 Request processed in 157us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.711749:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788330522.711849:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330522.711868:0:24989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd2c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c17 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.711878:0:24989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd2c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2c17 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330522.713065:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788330522.715632:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330522.719414:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788330522.719485:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788330522.719503:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788330522.719515:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788330522.719525:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788330522.719536:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788330522.719548:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788330522.719561:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788330522.719573:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788330522.719599:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788330522.719605:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788330522.719814:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330522.719885:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330522.720009:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788330522.720073:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792518656 00000100:00100000:1.0:1788330522.720082:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792518656 00000100:00100000:1.0:1788330522.720257:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788330522.720268:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792518656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330522.720464:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792518656:12345-0@lo:501:mount.lustre.0 Request processed in 197us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330522.720473:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788330522.720536:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330522.720572:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330522.720614:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.720786:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c90f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330522.720816:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792518784 00000100:00100000:0.0:1788330522.720827:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792518784 00000100:00100000:0.0:1788330522.720849:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788330522.720854:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792518784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330522.721611:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792518784:12345-0@lo:503:mount.lustre.0 Request processed in 753us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.721620:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788330522.721720:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518784:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788330522.722209:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330522.722327:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330522.722373:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.722415:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed3787240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330522.722821:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792518912 00000100:00100000:0.0:1788330522.722828:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792518912 00000100:00100000:0.0:1788330522.722864:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330522.722873:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792518912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330522.723383:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792518912:12345-0@lo:502:mount.lustre.0 Request processed in 509us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.723391:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788330522.723550:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792518912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330522.723757:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788330522.723787:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788330522.723803:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788330522.723830:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788330522.723847:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788330522.723861:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788330522.723876:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788330522.723891:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788330522.723904:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788330522.723935:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330522.723981:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.724007:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c90480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330522.724131:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792519040 00000100:00100000:0.0:1788330522.724137:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792519040 00000100:00100000:0.0:1788330522.724192:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788330522.724201:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792519040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330522.724311:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792519040:12345-0@lo:502:mount.lustre.0 Request processed in 111us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.724319:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788330522.724469:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330522.724509:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788330522.724517:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788330522.725200:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788330522.725208:0:24993:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788330522.725214:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330522.725216:0:24993:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788330522.725227:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788330522.725254:0:24993:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99eef5834d28) 00000020:00000080:0.0:1788330522.725340:0:24993:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788330522.725349:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788330522.725428:0:24993:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7c0d800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788330522.725437:0:24993:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788330522.725444:0:24993:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8475908e9fd2c25 00010000:00010000:0.0:1788330522.729822:0:24993:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788330522.732299:0:24993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1788330522.734332:0:24993:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788330522.737465:0:24993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788330522.737482:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330522.737490:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330522.737492:0:24993:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788330522.737499:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330522.737504:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330522.737505:0:24993:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788330522.737508:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788330522.737511:0:24993:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788330522.737513:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330522.737522:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330522.737523:0:24993:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788330522.737527:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330522.737530:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330522.737531:0:24993:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788330522.737535:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788330522.737569:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330522.737572:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330522.737573:0:24993:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788330522.737577:0:24993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788330522.744693:0:24989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788330522.744743:0:24989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788330522.744769:0:24989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd2c10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c17 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.744784:0:24989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd2c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c17 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330522.744793:0:24989:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7c0d800 from 1 10000000:01000000:0.0:1788330522.744796:0:24989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330522.744833:0:24989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.744842:0:24989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.744854:0:24989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330522.744879:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330522.744954:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330522.744997:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec98de0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330522.745038:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792519168 00000100:00100000:0.0:1788330522.745045:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792519168 00000100:00100000:0.0:1788330522.745093:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788330522.745111:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:24989:x1875199792519168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330522.745126:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330522.745140:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2c2c expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.745186:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.745197:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.745205:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79c00, rc 0) 00000100:00100000:0.0:1788330522.745255:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519168:12345-0@lo:101:mount.lustre.0 Request processed in 146us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.745262:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788330522.745311:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330522.745325:0:24989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.745334:0:24989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330522.749630:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788330522.749965:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330522.750127:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788330522.751485:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788330522.751518:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788330522.751531:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788330522.751544:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788330522.751556:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788330522.751568:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788330522.751580:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788330522.751594:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788330522.751607:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788330522.751618:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788330522.751638:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788330522.751644:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788330522.751757:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330522.751834:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.751890:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee67aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330522.754467:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792519296 00000100:00100000:1.0:1788330522.754482:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792519296 00000100:00100000:1.0:1788330522.754544:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788330522.754556:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330522.754764:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519296:12345-0@lo:501:mount.lustre.0 Request processed in 209us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330522.754772:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788330522.754945:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330522.755000:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330522.755056:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.755101:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330522.755568:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792519424 00000100:00100000:1.0:1788330522.755577:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792519424 00000100:00100000:1.0:1788330522.755634:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788330522.755644:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330522.755771:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519424:12345-0@lo:503:mount.lustre.0 Request processed in 128us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330522.755780:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788330522.755932:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788330522.757692:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330522.757812:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330522.757907:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.758026:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330522.759067:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792519552 00000100:00100000:1.0:1788330522.759081:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792519552 00000100:00100000:1.0:1788330522.759211:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788330522.759224:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330522.759900:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519552:12345-0@lo:502:mount.lustre.0 Request processed in 676us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330522.759919:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788330522.760143:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330522.760557:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788330522.760600:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788330522.760632:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788330522.760648:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788330522.760661:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788330522.760673:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788330522.760751:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788330522.760769:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788330522.760784:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788330522.760798:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788330522.760812:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788330522.760858:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330522.760920:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.761023:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330522.761212:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792519680 00000100:00100000:1.0:1788330522.761218:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792519680 00000100:00100000:1.0:1788330522.761386:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788330522.761397:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330522.761512:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519680:12345-0@lo:502:mount.lustre.0 Request processed in 116us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.761582:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330522.761634:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788330522.761643:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:1.0:1788330522.762557:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000020:01000000:3.0:1788330522.762797:0:24997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330522.762805:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330522.762807:0:24997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788330522.762814:0:24997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99edc7c0d800 00000020:00000080:3.0:1788330522.762816:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330522.762834:0:24997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330522.762837:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330522.762838:0:24997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788330522.762848:0:24997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330522.762850:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330522.762852:0:24997:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788330522.762855:0:24997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99edc7c0d800 00000020:00000080:3.0:1788330522.762857:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330522.762941:0:24997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330522.762944:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330522.762946:0:24997:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788330522.762948:0:24997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330522.762951:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330522.762952:0:24997:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788330522.762956:0:24997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99edc7c0d800 00000020:00000080:3.0:1788330522.762958:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330522.763579:0:24997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330522.763584:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330522.763585:0:24997:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788330522.763588:0:24997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330522.763591:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330522.763592:0:24997:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788330522.763595:0:24997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99edc7c0d800 00000020:00000080:3.0:1788330522.763597:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330522.763628:0:24997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330522.763631:0:24997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330522.763632:0:24997:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788330522.763635:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788330522.764198:0:24989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788330522.764229:0:24989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330522.764259:0:24989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.764280:0:24989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330522.764350:0:24989:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788330522.764353:0:24989:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99edc7c0d800 10000000:01000000:2.0:1788330522.764356:0:24989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99edc7c0d800 10000000:01000000:2.0:1788330522.764361:0:24989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788330522.764368:0:24989:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99edc7c0d800 from 1 10000000:01000000:2.0:1788330522.764372:0:24989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788330522.764416:0:24989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.764424:0:24989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.764436:0:24989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330522.764464:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330522.764534:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.764577:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788330522.764678:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792519808 00000100:00100000:3.0:1788330522.764697:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792519808 00000100:00100000:3.0:1788330522.764748:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788330522.764758:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:24989:x1875199792519808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330522.764774:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330522.764790:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7eea00/0x8475908e9fd2c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2c3a expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.764829:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7eea00/0x8475908e9fd2c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2c3a expref: 24 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.764838:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7eea00/0x8475908e9fd2c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2c3a expref: 24 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.764845:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7eea00, rc 0) 00000100:00100000:3.0:1788330522.764883:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792519808:12345-0@lo:101:mount.lustre.0 Request processed in 128us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330522.764888:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788330522.764956:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330522.764972:0:24989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c41 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.764981:0:24989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2c41 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330522.766536:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788330522.766859:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330522.767055:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788330522.767082:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788330522.767097:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788330522.767111:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788330522.767124:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788330522.767138:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788330522.768399:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788330522.768441:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788330522.768456:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788330522.768482:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788330522.768497:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788330522.768512:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788330522.768525:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788330522.768538:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788330522.768552:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788330522.768582:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788330522.768598:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788330522.768611:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788330522.768625:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788330522.768638:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788330522.768652:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788330522.768666:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788330522.768681:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788330522.768695:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788330522.768710:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788330522.768722:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788330522.768733:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788330522.768747:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788330522.768759:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788330522.768773:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788330522.768785:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788330522.768814:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788330522.768827:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788330522.768840:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788330522.768852:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788330522.768866:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788330522.768878:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788330522.768889:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788330522.768900:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788330522.768913:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788330522.768925:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788330522.768936:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788330522.768961:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788330522.768974:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788330522.768985:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788330522.768998:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788330522.769011:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788330522.769035:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788330522.769226:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788330522.769259:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788330522.770449:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788330522.770466:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788330522.770603:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330522.770684:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.771568:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788330522.771761:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792519936 00000100:00100000:3.0:1788330522.771774:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792519936 00000100:00100000:3.0:1788330522.771871:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788330522.771884:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792519936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330522.772074:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792519936:12345-0@lo:501:mount.lustre.0 Request processed in 193us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330522.772083:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788330522.772183:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792519936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330522.772250:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792520064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330522.772304:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.772471:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330522.772501:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792520064 00000100:00100000:0.0:1788330522.772506:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792520064 00000100:00100000:0.0:1788330522.772532:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788330522.772540:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792520064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330522.772666:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792520064:12345-0@lo:503:mount.lustre.0 Request processed in 127us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.772683:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788330522.775417:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792520064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788330522.775910:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330522.775994:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792520192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330522.776070:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.776118:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330522.776203:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792520192 00000100:00100000:2.0:1788330522.776210:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792520192 00000100:00100000:2.0:1788330522.776396:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788330522.776408:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792520192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330522.776520:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792520192:12345-0@lo:502:mount.lustre.0 Request processed in 113us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.777648:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792520192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330522.777870:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788330522.777900:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788330522.777913:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788330522.777924:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788330522.777936:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788330522.777961:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788330522.777976:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788330522.777987:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788330522.777998:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788330522.778010:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788330522.778022:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788330522.778035:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788330522.778047:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788330522.778059:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788330522.778072:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788330522.778084:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788330522.778094:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788330522.778105:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788330522.778117:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788330522.778130:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788330522.778142:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788330522.778186:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788330522.778201:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788330522.778214:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788330522.778226:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788330522.778252:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788330522.778268:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788330522.778349:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788330522.778371:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788330522.778385:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788330522.778397:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788330522.778409:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788330522.778422:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788330522.778436:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788330522.778448:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788330522.778459:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788330522.778471:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788330522.778497:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788330522.778513:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788330522.778523:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788330522.778534:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788330522.778546:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788330522.778558:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788330522.778567:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788330522.778580:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788330522.778593:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788330522.778605:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788330522.778616:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788330522.778664:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792520320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330522.778735:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330522.778778:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec98de480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330522.779441:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788330522.779496:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792520320 00000100:00100000:2.0:1788330522.779503:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792520320 00000100:00100000:2.0:1788330522.779542:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788330522.779551:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792520320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330522.779684:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792520320:12345-0@lo:502:mount.lustre.0 Request processed in 134us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.779691:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788330522.779853:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792520320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330522.780076:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788330522.780102:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788330522.780130:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792520448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330522.781441:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330522.781485:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec98de480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330522.782379:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792520448 00000100:00100000:2.0:1788330522.782391:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792520448 00000100:00100000:2.0:1788330522.782453:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788330522.782466:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792520448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330522.782620:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792520448:12345-0@lo:502:mount.lustre.0 Request processed in 157us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.782628:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788330522.784293:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792520448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330522.784407:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788330522.784436:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788330522.785653:0:25002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788330522.785671:0:25002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99eef6df3370) 00000020:00000080:3.0:1788330522.785698:0:25002:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788330522.785805:0:25002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7c0d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788330522.785810:0:25002:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7c0d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788330522.785813:0:25002:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7c0d800 3 00010000:00080000:3.0:1788330522.785855:0:25002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc7e01800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330522.789629:0:25002:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788330522.791783:0:25002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788330522.791836:0:25002:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330522.791856:0:25002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8475908e9fd2c4f 00000100:00080000:3.0:1788330522.791868:0:25002:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330522.791874:0:25002:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99edc7e01800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330522.791911:0:25002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7db0a80 x1875199792520576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330522.791948:0:25002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788330522.792001:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330522.792005:0:13408:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788330522.792007:0:13408:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330522.792011:0:13408:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 725 00000100:00080000:3.0:1788330522.792015:0:13408:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788330522.792019:0:13408:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99edc7d06800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330522.792032:0:13408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7db3b80 x1875199792520960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330522.792074:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330522.792077:0:13408:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788330522.792079:0:13408:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330522.792083:0:13408:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 725 00000100:00080000:3.0:1788330522.792086:0:13408:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788330522.792089:0:13408:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99eeffa6f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330522.792100:0:13408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7db2300 x1875199792521472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330522.792145:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792520704:0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.792249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.792396:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792521088:0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.792449:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792521344:0@lo:400:kworker.0 00000100:00100000:0.0:1788330522.792525:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792520576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330522.792610:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.792634:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792521728:0@lo:400:kworker.0 00000100:00100000:2.0:1788330522.792655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.792676:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788330522.792682:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792521216:0@lo:400:kworker.0 00000100:00100000:2.0:1788330522.792703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.792721:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792521856:0@lo:400:kworker.0 00000100:00100000:2.0:1788330522.792741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.792773:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792521088 00000100:00100000:2.0:1788330522.792785:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792521088 00000100:00100000:2.0:1788330522.792821:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792521728 00000100:00100000:2.0:1788330522.792824:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792521728 00000100:00100000:2.0:1788330522.792849:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792521856 00000100:00100000:2.0:1788330522.792852:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792521856 00000100:00100000:2.0:1788330522.792870:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330522.792879:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792521088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330522.792927:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792521088:12345-0@lo:400:kworker.0 Request processed in 49us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.792935:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330522.792951:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330522.792956:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792521728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330522.792981:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792521728:12345-0@lo:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.792986:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330522.792997:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788330522.793003:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792521856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330522.793029:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792521856:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.793034:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788330522.793072:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7db2d80 x1875199792521856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330522.793085:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792521856:0@lo:400:kworker.0 00010000:00080000:2.0:1788330522.793096:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7db0380 x1875199792521088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330522.793104:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792521088:0@lo:400:kworker.0 00010000:00080000:2.0:1788330522.793120:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7db0000 x1875199792521728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330522.793128:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792521728:0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.793378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330522.793444:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788330522.793452:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792520832:0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.793478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330522.793550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330522.793579:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792520960:0@lo:8:kworker.0 00000100:00100000:3.0:1788330522.794547:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792521600:0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.794584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330522.794627:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792520704 00000100:00100000:3.0:1788330522.794633:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792520704 00000100:00100000:3.0:1788330522.794670:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792521216 00000100:00100000:3.0:1788330522.794673:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792521216 00000100:00100000:3.0:1788330522.794686:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330522.794693:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792520704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.794740:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792520704:12345-0@lo:400:kworker.0 Request processed in 47us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330522.794746:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330522.794762:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788330522.794767:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792521216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.794795:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792521216:12345-0@lo:400:kworker.0 Request processed in 29us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330522.794800:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788330522.794818:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330522.794822:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330522.794830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330522.794893:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792521344 00000100:00100000:2.0:1788330522.794897:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792521344 00000100:00100000:0.0:1788330522.794946:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792520832 00000100:00100000:0.0:1788330522.794950:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792520832 00000100:00100000:0.0:1788330522.794975:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330522.794982:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792521344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330522.795018:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792521344:12345-0@lo:400:kworker.0 Request processed in 37us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.795025:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330522.795038:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330522.795044:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792520832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330522.795069:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792520832:12345-0@lo:400:kworker.0 Request processed in 26us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330522.795075:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330522.795216:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792521472:0@lo:8:kworker.0 00000100:00100000:3.0:1788330522.795346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330522.795378:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792520960 00000100:00100000:3.0:1788330522.795382:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792520960 00000100:00100000:3.0:1788330522.795406:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792521472 00000100:00100000:3.0:1788330522.795410:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792521472 00000100:00100000:3.0:1788330522.795418:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330522.795422:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792520960:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788330522.795471:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792520960:12345-0@lo:8:kworker.0 Request processed in 48us (640us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788330522.795478:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330522.795489:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330522.795492:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792521472:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788330522.795521:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792521472:12345-0@lo:8:kworker.0 Request processed in 27us (176us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788330522.795527:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330522.795560:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330522.795568:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330522.795572:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788330522.795575:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792520960:0@lo:8:kworker.0 00000100:00100000:3.0:1788330522.795585:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330522.795588:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330522.795591:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788330522.795593:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792521472:0@lo:8:kworker.0 00000100:00100000:3.0:1788330522.795630:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792520832:0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.795643:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792520704:0@lo:400:kworker.0 00000100:00100000:3.0:1788330522.795654:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792521344:0@lo:400:kworker.0 00000100:00100000:2.0:1788330522.796384:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792520576 00000100:00100000:2.0:1788330522.796393:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792520576 00000100:00100000:2.0:1788330522.796418:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792521600 00000100:00100000:2.0:1788330522.796421:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792521600 00000100:00100000:2.0:1788330522.796445:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330522.796452:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792521600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330522.796514:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792521600:12345-0@lo:400:kworker.0 Request processed in 63us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.796520:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330522.796536:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330522.796540:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792520576:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788330522.796560:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:2.0:1788330522.796609:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8475908e9fd2c56 00000004:00100000:2.0:1788330522.796626:0:22670:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788330522.796658:0:22670:0:(import.c:65:import_set_state_nolock()) ffff99edc7f3a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330522.796697:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875199792520576:12345-0@lo:38:llog_process_th.0 Request processed in 155us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.796704:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330522.796749:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792521216:0@lo:400:kworker.0 00000100:00080000:2.0:1788330522.796769:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330522.796855:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7db0a80 x1875199792520576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330522.796877:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330522.796883:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788330522.796890:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788330522.796896:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788330522.796899:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e01800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788330522.796904:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792520576:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788330522.796945:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7db3800 x1875199792521600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330522.796955:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792521600:0@lo:400:kworker.0 00000020:01000004:3.0:1788330522.797059:0:25002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788330522.797073:0:25002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99eef6df19b8) 00000020:00000080:3.0:1788330522.797090:0:25002:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788330522.797189:0:25002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7c0d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788330522.797193:0:25002:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7c0d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788330522.797195:0:25002:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7c0d800 3 00010000:00080000:3.0:1788330522.797220:0:25002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc7e00000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330522.799120:0:25002:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788330522.800289:0:25002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788330522.800344:0:25002:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330522.800359:0:25002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x8475908e9fd2c64 00000100:00080000:3.0:1788330522.800372:0:25002:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330522.800379:0:25002:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99edc7e00000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330522.800419:0:25002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7db3800 x1875199792521984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330522.800457:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792521984:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788330522.800565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330522.800639:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792521984 00000100:00100000:3.0:1788330522.800647:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792521984 00000100:00100000:3.0:1788330522.800681:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330522.800689:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792521984:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788330522.800715:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:3.0:1788330522.800757:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x8475908e9fd2c6b 00000004:00100000:3.0:1788330522.800776:0:22670:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788330522.800808:0:22670:0:(import.c:65:import_set_state_nolock()) ffff99edc7e06800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330522.800860:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875199792521984:12345-0@lo:38:llog_process_th.0 Request processed in 170us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330522.800867:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788330522.800909:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7db3800 x1875199792521984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330522.800920:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330522.800927:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788330522.800934:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788330522.800938:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788330522.800940:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e00000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788330522.800946:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792521984:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788330522.800968:0:25002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1788330522.801402:0:25002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788330522.801594:0:24989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788330522.801629:0:24989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788330522.801651:0:24989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c41 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.801662:0:24989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c41 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788330522.801714:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788330522.801716:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788330522.801717:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330522.801718:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330522.801719:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330522.801721:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330522.801726:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330522.801728:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330522.801729:0:24989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788330522.801733:0:24989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788330522.801735:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788330522.801736:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788330522.801737:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330522.801738:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330522.801739:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330522.801740:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330522.801741:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330522.801742:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330522.801742:0:24989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788330522.801760:0:24989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788330522.801774:0:24989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792522112:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788330522.801824:0:24989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330522.801846:0:24989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec98de480 going to sleep for 11 seconds 00000100:00100000:1.0:1788330522.803204:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792522112 00000100:00100000:1.0:1788330522.803215:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792522112 00000100:00100000:1.0:1788330522.803288:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788330522.803297:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792522112:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788330522.803328:0:22662:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788330522.803343:0:22662:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788330522.820758:0:22662:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788330522.820790:0:22662:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788330522.821093:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:24989:x1875199792522112:12345-0@lo:253:mount.lustre.0 Request processed in 17792us (19263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330522.821107:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:1.0:1788330522.821246:0:22684:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788330522.821252:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788330522.821279:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330522.821295:0:22684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330522.821303:0:22684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330522.821322:0:22684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330522.821364:0:22684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330522.821379:0:22684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 23 pid: 22662 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330522.821393:0:22684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792522240:0@lo:104: 00000100:00100000:1.0:1788330522.821430:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330522.821482:0:22684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330522.821491:0:22684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 23 pid: 22664 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330522.821499:0:22684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792522368:0@lo:104: 00000100:00100000:1.0:1788330522.821522:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330522.821540:0:22684:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330522.821559:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792522240 00000100:00100000:1.0:1788330522.821567:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792522240 00000100:00100000:1.0:1788330522.821598:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792522368 00000100:00100000:1.0:1788330522.821601:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792522368 00000100:00100000:1.0:1788330522.821613:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788330522.821623:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:22684:x1875199792522240:12345-0@lo:104: 00010000:00010000:1.0:1788330522.821636:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330522.821696:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330522.821702:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:22684:x1875199792522240:12345-0@lo:104: Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330522.821708:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788330522.821721:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330522.821727:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:22684:x1875199792522368:12345-0@lo:104: 00010000:00010000:1.0:1788330522.821734:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330522.821773:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788330522.821778:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:22684:x1875199792522368:12345-0@lo:104: Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330522.821785:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330522.821817:0:22684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792522240:0@lo:104: 00000100:00100000:1.0:1788330522.821826:0:22684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22684:1875199792522368:0@lo:104: 00010000:00010000:1.0:1788330522.821846:0:22684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330522.822021:0:24989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e95a55f7-77f3-48c4-a98a-95aef9b6d238:24989:1875199792522112:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330522.822033:0:24989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788330522.822037:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330522.822045:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330522.822046:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330522.822047:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330522.822049:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330522.822050:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330522.822051:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330522.822053:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330522.822054:0:24989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788330522.822069:0:24989:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788330522.822402:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330522.822409:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.822417:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eec00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330522.822421:0:22657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.822430:0:22657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330522.822437:0:22657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330522.822443:0:22657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330522.822450:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330522.823415:0:22657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.823425:0:22657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330522.823447:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.823455:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd2b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2b0d expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330522.823466:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330522.823468:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330522.823476:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330522.823559:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330522.823561:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330522.823563:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330522.823564:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.823572:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7efa00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330522.823575:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.823583:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330522.823589:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330522.823594:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788330522.823603:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792522496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330522.823666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:3.0:1788330522.824383:0:24989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788330522.826713:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792522496 00000100:00100000:2.0:1788330522.826729:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792522496 00010000:00010000:3.0:1788330522.826845:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 24 pid: 22662 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330522.826921:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330522.826931:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3646:x1875199792522496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330522.826956:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330522.826963:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 24 pid: 22662 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.826976:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 24 pid: 22662 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.826995:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2b0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2b06 expref: 24 pid: 22662 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.827012:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330522.827094:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:3646:x1875199792522496:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330522.827101:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:1.0:1788330522.827325:0:24989:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788330522.827332:0:24989:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788330522.827374:0:24989:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788330522.827423:0:24989:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788330522.827452:0:24989:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788330522.827480:0:24989:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00010000:00010000:0.0:1788330522.828077:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.828097:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330522.828118:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.828126:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd2af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2aff expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330522.828143:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330522.828145:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330522.828147:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788330522.828382:0:24989:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330522.828627:0:24989:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788330522.834074:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792522496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330522.834126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330522.834138:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792522624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330522.834232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330522.834308:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792522624 00000100:00100000:3.0:1788330522.834316:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792522624 00010000:00010000:3.0:1788330522.834351:0:23824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 23 pid: 22664 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330522.834384:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330522.834393:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:3646:x1875199792522624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330522.834409:0:23824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330522.834414:0:23824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 23 pid: 22664 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834427:0:23824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 23 pid: 22664 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834447:0:23824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9039800/0x8475908e9fd2aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2af8 expref: 23 pid: 22664 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834466:0:23824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834474:0:23824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788330522.834491:0:23824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013239239s 00010000:00010000:3.0:1788330522.834495:0:23824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834512:0:23824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834519:0:23824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834526:0:23824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834532:0:23824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330522.834537:0:23824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834545:0:23824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834561:0:23824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834572:0:23824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330522.834608:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:3646:x1875199792522624:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330522.834616:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330522.834651:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792522624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330522.834673:0:22684:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834681:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330522.834698:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeffb92600/0x8475908e9fd2c72 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330523.100499:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788330523.884542:0:25057:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330523.884848:0:25057:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330524.141657:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788330524.507292:0:22666:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788330524.507304:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d04000 from 14 10000000:01000000:0.0:1788330524.507311:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788330524.507373:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79400/0x8475908e9fd2c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330524.507395:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79400/0x8475908e9fd2c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330524.507409:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79400/0x8475908e9fd2c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330524.507440:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792522752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330524.507527:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330524.507583:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788330524.507661:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792522752 00000100:00100000:3.0:1788330524.507672:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792522752 00000100:00100000:3.0:1788330524.507741:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788330524.507752:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:22666:x1875199792522752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330524.507767:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330524.507783:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2c80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2c79 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330524.507812:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2c79 expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330524.507823:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2c79 expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330524.507835:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ef400, rc 0) 00000100:00100000:3.0:1788330524.507881:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792522752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330524.507889:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788330524.508317:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792522752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330524.508355:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79400/0x8475908e9fd2c79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c80 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330524.508365:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79400/0x8475908e9fd2c79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2c80 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330524.508436:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792522880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788330524.508476:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330524.508500:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330524.508622:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792522880 00000100:00100000:0.0:1788330524.508627:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792522880 00000100:00100000:0.0:1788330524.508674:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330524.508682:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792522880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330524.508706:0:22662:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330524.508726:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330524.508729:0:22662:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788330524.508816:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792522880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330524.508824:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788330524.509079:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792522880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788330524.509177:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330524.509186:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79400/0x8475908e9fd2c79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c80 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330524.509195:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79400/0x8475908e9fd2c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c80 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330524.509205:0:22666:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788330524.509208:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee7213000 from 14 10000000:01000000:1.0:1788330524.509211:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788330524.509239:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeffb92000/0x8475908e9fd2c87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330524.509247:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eeffb92000/0x8475908e9fd2c87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330524.509261:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eeffb92000/0x8475908e9fd2c87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330524.509286:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792523008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330524.509313:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330524.509334:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330524.509512:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792523008 00000100:00100000:0.0:1788330524.509517:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792523008 00000100:00100000:0.0:1788330524.509555:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788330524.509563:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792523008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330524.509573:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330524.509586:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78600/0x8475908e9fd2c8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2c87 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330524.509605:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78600/0x8475908e9fd2c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2c87 expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330524.509615:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78600/0x8475908e9fd2c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2c87 expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330524.509624:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78600, rc 0) 00000100:00100000:0.0:1788330524.509669:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:22666:x1875199792523008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330524.509674:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788330524.509800:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792523008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330524.509812:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eeffb92000/0x8475908e9fd2c87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c8e expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330524.509832:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eeffb92000/0x8475908e9fd2c87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2c8e expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330524.509876:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792523136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788330524.509908:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330524.509948:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330524.510036:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792523136 00000100:00100000:0.0:1788330524.510040:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792523136 00000100:00100000:0.0:1788330524.510070:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788330524.510077:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:22666:x1875199792523136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330524.510098:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330524.510113:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330524.510116:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788330524.510205:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:22666:x1875199792523136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330524.510212:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788330524.510322:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792523136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788330524.510380:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330524.510397:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeffb92000/0x8475908e9fd2c87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c8e expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330524.510406:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eeffb92000/0x8475908e9fd2c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2c8e expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330525.147886:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330525.595573:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792523264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330525.595758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330525.595868:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792523264 00000100:00100000:0.0:1788330525.595877:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792523264 00000100:00100000:0.0:1788330525.595957:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330525.595971:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792523264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330525.596011:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330525.596061:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792523264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330525.596069:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788330525.596096:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330525.596172:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792523264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330525.596199:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330525.596205:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792523392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330525.596447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330525.597761:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330525.597787:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792523520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330525.597862:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330525.604173:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792523392 00000100:00100000:1.0:1788330525.604196:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792523392 00000100:00100000:1.0:1788330525.604353:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792523520 00000100:00100000:1.0:1788330525.604358:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792523520 00000100:00100000:1.0:1788330525.604463:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788330525.604477:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792523392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330525.604529:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788330525.604632:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792523392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (8185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330525.604640:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788330525.604659:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788330525.604666:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792523520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330525.604686:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788330525.604720:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792523520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (6858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330525.604726:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788330525.606674:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792523520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330525.610752:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792523392:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788330526.173423:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330526.624040:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330526.624076:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792523648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330526.624252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330526.624340:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792523648 00000100:00100000:1.0:1788330526.624351:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792523648 00000100:00100000:1.0:1788330526.624459:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788330526.624474:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792523648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330526.624510:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330526.624581:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792523648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330526.624592:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788330526.624643:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330526.624717:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792523648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330527.195507:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330527.590721:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788330528.155331:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330528.155338:0:13408:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788330528.155341:0:13408:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330528.155353:0:13408:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99edc7d06800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330528.155377:0:13408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7db1500 x1875199792524160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330528.155428:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330528.155431:0:13408:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788330528.155433:0:13408:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330528.155438:0:13408:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99eeffa6f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330528.155449:0:13408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7697800 x1875199792524672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330528.155505:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792523904:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155620:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792524544:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155663:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792525184:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155713:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788330528.155720:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792523776:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155746:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155768:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792524416:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155805:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792525056:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155851:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792524032:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155890:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792524800:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155930:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792525312:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155958:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788330528.155962:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792524288:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.155979:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.155989:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792524928:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.156010:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.156031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792524160:0@lo:8:kworker.0 00000100:00100000:3.0:1788330528.156054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.156070:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792524672:0@lo:8:kworker.0 00000100:00100000:3.0:1788330528.156088:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.156120:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792523904 00000100:00100000:3.0:1788330528.156127:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792523904 00000100:00100000:3.0:1788330528.156202:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792524416 00000100:00100000:3.0:1788330528.156206:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792524416 00000100:00100000:3.0:1788330528.156223:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330528.156231:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792523904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.156284:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792523904:12345-0@lo:400:kworker.0 Request processed in 53us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.156291:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330528.156308:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330528.156313:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792524416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.156340:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792524416:12345-0@lo:400:kworker.0 Request processed in 28us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.156345:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330528.156364:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792524544 00000100:00100000:3.0:1788330528.156373:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792524544 00000100:00100000:3.0:1788330528.156407:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792524032 00000100:00100000:3.0:1788330528.156409:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792524032 00000100:00100000:3.0:1788330528.156420:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792524160 00000100:00100000:3.0:1788330528.156423:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792524160 00000100:00100000:3.0:1788330528.156432:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792524672 00000100:00100000:3.0:1788330528.156435:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792524672 00000100:00100000:3.0:1788330528.156445:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330528.156451:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792524544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.156482:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792524544:12345-0@lo:400:kworker.0 Request processed in 32us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.156489:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330528.156501:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330528.156507:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792524032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.156537:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792524032:12345-0@lo:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.156542:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330528.156552:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330528.156556:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792524160:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788330528.156581:0:24178:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:3.0:1788330528.156610:0:24178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd2c95 00002000:00100000:3.0:1788330528.156624:0:24178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99edc7e06000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788330528.156628:0:24178:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788330528.156631:0:24178:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788330528.156816:0:24178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788330528.156841:0:24178:0:(import.c:65:import_set_state_nolock()) ffff99edc7e04000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330528.156878:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792524160:12345-0@lo:8:kworker.0 Request processed in 320us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.156892:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330528.156906:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788330528.156910:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792524672:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788330528.156924:0:24178:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:3.0:1788330528.156938:0:24178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd2c9c 00002000:00100000:3.0:1788330528.156945:0:24178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99edc7e04800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788330528.156948:0:24178:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788330528.156950:0:24178:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788330528.156972:0:24178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788330528.156984:0:24178:0:(import.c:65:import_set_state_nolock()) ffff99edc7e01000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330528.157011:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792524672:12345-0@lo:8:kworker.0 Request processed in 99us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.157017:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788330528.157038:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792525184 00000100:00100000:3.0:1788330528.157043:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792525184 00000100:00100000:3.0:1788330528.157066:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792525056 00000100:00100000:3.0:1788330528.157069:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792525056 00000100:00100000:3.0:1788330528.157080:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792524800 00000100:00100000:3.0:1788330528.157082:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792524800 00000100:00100000:3.0:1788330528.157089:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792525312 00000100:00100000:3.0:1788330528.157092:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792525312 00000100:00100000:3.0:1788330528.157100:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792524288 00000100:00100000:3.0:1788330528.157102:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792524288 00000100:00100000:3.0:1788330528.157111:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792524928 00000100:00100000:3.0:1788330528.157113:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792524928 00000100:00100000:3.0:1788330528.157123:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330528.157129:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792525184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157194:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792525184:12345-0@lo:400:kworker.0 Request processed in 55us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.157208:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330528.157220:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330528.157225:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792525056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157253:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792525056:12345-0@lo:400:kworker.0 Request processed in 29us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.157258:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330528.157268:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330528.157272:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792524800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157297:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792524800:12345-0@lo:400:kworker.0 Request processed in 25us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.157302:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330528.157312:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330528.157318:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792525312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157358:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792525312:12345-0@lo:400:kworker.0 Request processed in 40us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.157363:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330528.157374:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330528.157380:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792524288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157403:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792524288:12345-0@lo:400:kworker.0 Request processed in 24us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.157408:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330528.157417:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788330528.157422:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792524928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157445:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792524928:12345-0@lo:400:kworker.0 Request processed in 24us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.157457:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788330528.157479:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792523776 00000100:00100000:3.0:1788330528.157482:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792523776 00000100:00100000:3.0:1788330528.157509:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788330528.157516:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3649:x1875199792523776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157547:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3649:x1875199792523776:12345-0@lo:400:kworker.0 Request processed in 32us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.157553:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788330528.157607:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330528.157612:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330528.157614:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330528.157648:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7db1500 x1875199792524160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330528.157666:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788330528.157674:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788330528.157680:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788330528.157683:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7d06800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788330528.157708:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788330528.157714:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792524160:0@lo:8:kworker.0 00010000:00080000:3.0:1788330528.157729:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7697800 x1875199792524672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330528.157738:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788330528.157742:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788330528.157745:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788330528.157748:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eeffa6f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788330528.157759:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788330528.157769:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792524672:0@lo:8:kworker.0 00010000:00080000:3.0:1788330528.157805:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7db1c00 x1875199792524288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330528.157815:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792524288:0@lo:400:kworker.0 00010000:00080000:3.0:1788330528.157825:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc75fdc00 x1875199792524928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330528.157833:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792524928:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157844:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792524032:0@lo:400:kworker.0 00010000:00080000:3.0:1788330528.157853:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc75fd500 x1875199792524800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330528.157860:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792524800:0@lo:400:kworker.0 00010000:00080000:3.0:1788330528.157868:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc75fea00 x1875199792525312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330528.157876:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792525312:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157907:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792523776:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157917:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792524416:0@lo:400:kworker.0 00010000:00080000:3.0:1788330528.157926:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc75fe300 x1875199792525056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330528.157934:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792525056:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157944:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792523904:0@lo:400:kworker.0 00000100:00100000:3.0:1788330528.157953:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792524544:0@lo:400:kworker.0 00010000:00080000:3.0:1788330528.157970:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc75fed80 x1875199792525184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330528.157978:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792525184:0@lo:400:kworker.0 00000004:00080000:1.0:1788330528.158165:0:22695:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788330528.158201:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22695:1875199792525568:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788330528.158238:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330528.158257:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920c180 going to sleep for 11 seconds 00000004:00080000:1.0:1788330528.158274:0:23412:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788330528.158354:0:23412:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 732130202135ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788330528.158360:0:23412:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788330528.158585:0:22694:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788330528.158630:0:22694:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732130478662ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788330528.158635:0:22694:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788330528.162342:0:23413:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788330528.162374:0:23413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23413:1875199792525824:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788330528.162445:0:23413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330528.162476:0:23413:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef40399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330528.162497:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792525696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330528.162522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330528.162568:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792525696 00000100:00100000:2.0:1788330528.162575:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792525696 00000100:00100000:2.0:1788330528.162633:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330528.162643:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875199792525696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330528.162671:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788330528.162717:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875199792525696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330528.162724:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788330528.162764:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec995d500 x1875199792525696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330528.162783:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792525696:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788330528.166207:0:23402:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788330528.166916:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792525568 00000100:00100000:3.0:1788330528.166928:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792525568 00000100:00100000:3.0:1788330528.166990:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792525824 00000100:00100000:3.0:1788330528.166994:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792525824 00000100:00100000:3.0:1788330528.167020:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330528.167030:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22695:x1875199792525568:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788330528.167319:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330528.167328:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23413:x1875199792525824:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788330528.167370:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792525440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330528.167438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.167489:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792525440 00000100:00100000:3.0:1788330528.167493:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792525440 00000100:00100000:3.0:1788330528.167537:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330528.167545:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792525440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330528.167558:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788330528.167603:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792525440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.167610:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788330528.167636:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330528.167669:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eed82d2300 x1875199792525440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330528.167689:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792525440:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1788330528.168560:0:24662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788330528.168569:0:24662:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788330528.168585:0:24662:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:3.0:1788330528.177102:0:24176:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788330528.177113:0:24176:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788330528.177299:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23413:x1875199792525824:12345-0@lo:7:osp-pre-1-1.0 Request processed in 9966us (14848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.177312:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1788330528.177330:0:22649:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:3.0:1788330528.177378:0:23413:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec995f100 x1875199792525824/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788330544 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330528.177395:0:23413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23413:1875199792525824:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788330528.177408:0:23413:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788330528.177448:0:23413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23413:1875199792525952:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788330528.177483:0:23413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.177518:0:23413:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7bb9780 going to sleep for 11 seconds 00002000:00010000:3.0:1788330528.177670:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.177679:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.177694:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.177698:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.177705:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.177721:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.177744:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.177752:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.177768:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330528.178098:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.178105:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178114:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.178117:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.178122:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178132:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178140:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178147:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178210:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330528.178281:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330528.178288:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178296:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.178300:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178310:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178327:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178335:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2ca3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178351:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.178355:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178360:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.178363:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178381:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178392:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178400:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd2caa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.178410:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.178413:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.178416:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.178420:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330528.178446:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792525952 00000100:00100000:0.0:1788330528.178454:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792525952 00000100:00100000:0.0:1788330528.178516:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330528.178526:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23413:x1875199792525952:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788330528.178552:0:24178:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788330528.178606:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23413:x1875199792525952:12345-0@lo:5:osp-pre-1-1.0 Request processed in 83us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330528.178613:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330528.178650:0:23413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23413:1875199792525952:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788330528.178659:0:23413:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788330528.178692:0:23413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23413:1875199792526080:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788330528.178723:0:23413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330528.178745:0:23413:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e300 going to sleep for 11 seconds 00002000:00010000:3.0:1788330528.178746:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.178754:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330528.178759:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792526080 00010000:00010000:3.0:1788330528.178765:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=732s v=(0 0) 00000100:00100000:0.0:1788330528.178765:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792526080 00010000:00010000:3.0:1788330528.178772:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.178778:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178789:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330528.178794:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788330528.178804:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330528.178805:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23413:x1875199792526080:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1788330528.178820:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788330528.178828:0:24176:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:3.0:1788330528.178838:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330528.178850:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.178855:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178864:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.178868:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178876:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178888:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178896:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c879b9e4/0x8475908e9fd2cb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.178911:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.178913:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.178915:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.179308:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.179320:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179330:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.179333:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.179337:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179346:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179354:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179361:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179493:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330528.179781:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.179787:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179796:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.179799:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.179803:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179812:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179825:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.179832:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180335:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330528.180347:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330528.180353:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.180354:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.180363:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180365:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eee00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.180372:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.180379:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7efc00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.180384:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.180385:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.180407:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180413:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180423:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ac33959/0x8475908e9fd2cb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.180443:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180452:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.180453:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2cbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180463:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.180466:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.180474:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.180477:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.180479:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.180924:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.180931:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180940:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.180944:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.180949:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180959:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180967:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180973:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.180994:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330528.181324:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.181329:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181337:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.181339:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.181343:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181357:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181364:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181371:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181386:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330528.181396:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330528.181401:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181407:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.181410:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181417:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181428:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181434:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2cc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181453:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.181456:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181462:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.181465:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181471:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181480:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181487:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd2ccd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181498:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.181499:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.181501:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.181815:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.181821:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181829:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.181832:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.181841:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181851:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181858:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181866:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.181878:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330528.182117:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.182123:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182131:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.182134:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.182137:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182146:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182177:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182208:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182283:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330528.182294:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330528.182299:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182308:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.182312:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182320:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182333:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182342:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6da3c8d/0x8475908e9fd2cd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182357:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.182361:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182379:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.182382:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182389:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182398:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182404:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd2cdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182417:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.182419:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.182421:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.182732:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.182738:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182747:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.182750:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.182754:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182763:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182778:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182784:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182801:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330528.182809:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.182812:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182817:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.182820:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182826:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182839:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182845:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd2ce2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.182859:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.182866:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.182868:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.183090:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.183096:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183104:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.183107:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.183111:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183120:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183127:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183134:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183146:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330528.183174:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.183179:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183217:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.183281:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183301:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183312:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183319:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2ce9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183334:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.183335:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.183337:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.183648:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.183654:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183661:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.183664:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.183668:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183677:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183685:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183698:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183712:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330528.183719:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.183722:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183729:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eec00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.183732:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183739:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183749:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183755:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2cf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.183770:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.183772:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.183774:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.183995:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.184008:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184016:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.184019:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.184023:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184033:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184041:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184048:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184063:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330528.184072:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.184076:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184083:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7efa00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.184087:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184094:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184111:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184118:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a072369/0x8475908e9fd2cf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184131:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.184133:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.184135:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.184256:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.184262:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.184491:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.184497:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184506:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.184509:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.184513:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184523:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184531:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184539:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184696:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330528.184707:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.184711:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184718:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91a200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.184721:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184729:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184741:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184749:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064e4823b/0x8475908e9fd2cfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.184765:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.184768:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.184770:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.185048:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.185054:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185062:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.185072:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.185077:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185087:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185096:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185103:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185118:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330528.185169:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330528.185176:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185195:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91ae00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330528.185199:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185207:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185219:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185226:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009360823e/0x8475908e9fd2d05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185248:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.185268:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.185270:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.185673:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.185679:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185688:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.185691:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.185695:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185705:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185713:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185726:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.185748:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330528.185770:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330528.185776:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185785:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91a800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330528.185788:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185797:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185810:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185817:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007184cbbb/0x8475908e9fd2d0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.185834:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.185836:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.185838:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.186034:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.186040:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186048:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.186051:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.186055:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186064:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186071:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186079:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186283:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330528.186515:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.186521:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186536:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.186539:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.186543:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186620:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186628:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.186634:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.190207:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788330528.190850:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.190860:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.190876:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.190881:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.190887:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.190899:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.190919:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.190927:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.190946:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788330528.191278:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.191285:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191293:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.191296:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.191300:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191309:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191315:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191322:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191341:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788330528.191671:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.191677:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191686:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.191689:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.191692:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191702:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191710:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191717:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191725:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788330528.191975:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.191981:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.191989:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.191996:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.192001:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192009:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192016:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192022:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192030:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788330528.192680:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.192687:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192697:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.192700:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.192703:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192713:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192722:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192736:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.192743:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1788330528.193243:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788330528.193252:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193262:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91be00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330528.193266:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193275:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193305:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193313:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000363e7cb7/0x8475908e9fd2d13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193338:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788330528.193342:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330528.193346:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330528.193352:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91b000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.193355:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193357:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.193378:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1788330528.193379:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.193388:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.193395:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193396:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193417:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b1f3a29/0x8475908e9fd2d1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.193419:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.193434:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193437:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788330528.193446:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.193447:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.193462:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788330528.193465:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91aa00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330528.193469:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193478:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193491:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193499:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4caa205/0x8475908e9fd2d21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193515:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788330528.193520:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193526:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91bc00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330528.193530:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193538:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193548:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193561:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d531ed/0x8475908e9fd2d28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193575:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788330528.193579:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193585:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91b600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330528.193588:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193596:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193606:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193613:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000210efb1f/0x8475908e9fd2d2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193624:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788330528.193627:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193633:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91b800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330528.193642:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193649:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193659:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193665:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0815498/0x8475908e9fd2d36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193678:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330528.193681:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193687:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91ac00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330528.193690:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193695:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193703:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193709:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9468845/0x8475908e9fd2d3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193726:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330528.193728:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193734:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0031000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330528.193737:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193745:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193753:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193759:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062201cef/0x8475908e9fd2d44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330528.193770:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330528.193772:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330528.193773:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.193918:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.193939:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.193943:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.194112:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.194119:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194133:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.194136:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.194140:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194166:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194176:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194183:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194212:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330528.194216:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330528.194222:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.194229:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0030e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330528.194232:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.194239:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.194249:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.194256:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b68dd659/0x8475908e9fd2d4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.194269:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.194270:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.194272:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.194656:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.194662:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194671:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.194674:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.194679:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194688:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194708:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194715:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194732:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330528.194741:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330528.194745:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194753:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0030200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330528.194757:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194764:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194775:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194782:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075bc078f/0x8475908e9fd2d52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.194796:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.194802:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330528.194804:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.195696:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.195703:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.195715:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.195718:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.195724:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.195733:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.195741:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.195747:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.195767:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330528.197128:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.197140:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197169:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.197174:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.197179:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197210:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197220:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197228:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197250:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788330528.197413:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330528.197421:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197430:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0031e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330528.197434:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197454:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197468:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197475:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1d178d0/0x8475908e9fd2d59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197491:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330528.197495:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197500:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0030a00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330528.197503:0:25008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197510:0:25008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197519:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197527:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5c8ba8/0x8475908e9fd2d60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.197552:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.197554:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.197555:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.197561:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330528.197751:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.197757:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197766:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.197770:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.197774:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197784:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197792:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197811:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.197836:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330528.198098:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.198103:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198112:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.198116:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.198121:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198130:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198137:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198145:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198216:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788330528.198697:0:24662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330528.198704:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198722:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1788330528.198725:0:24662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330528.198729:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198740:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198749:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198756:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330528.198770:0:24662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1788330528.198803:0:24662:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1788330528.198899:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22695:x1875199792525568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 31866us (40656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330528.198910:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330528.198971:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22695:1875199792525568:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788330528.198988:0:22695:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788330528.199035:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22695:1875199792526208:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788330528.199072:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330528.199094:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59f3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330528.199119:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792526208 00000100:00100000:3.0:1788330528.199125:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792526208 00000100:00100000:3.0:1788330528.199204:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330528.199216:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22695:x1875199792526208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788330528.199263:0:24177:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:0.0:1788330528.199337:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788330528.199345:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199355:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0031800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330528.199359:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199368:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199382:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199389:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794b474e/0x8475908e9fd2d67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199404:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330528.199407:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199414:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0030c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330528.199423:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199431:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199442:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199449:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024aa7369/0x8475908e9fd2d6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199463:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330528.199467:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199473:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0030000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330528.199476:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199484:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199495:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199502:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9a82e6e/0x8475908e9fd2d75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330528.199521:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.199524:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.199526:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.199533:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330528.199544:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788330528.203845:0:24990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788330528.203888:0:24990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788330528.203892:0:24990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788330528.204033:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22695:x1875199792526208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4817us (4957us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788330528.204044:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330528.204099:0:22695:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788330528.204106:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22695:1875199792526208:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788330528.204121:0:22695:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:1.0:1788330528.215620:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23413:x1875199792526080:12345-0@lo:5:osp-pre-1-1.0 Request processed in 36809us (36888us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788330528.215634:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788330528.215876:0:23413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc65b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23413:1875199792526080:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788330528.215891:0:23413:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788330528.215931:0:23413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23413:1875199792526336:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788330528.215970:0:23413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330528.215999:0:23413:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788330528.216047:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792526336 00000100:00100000:1.0:1788330528.216054:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792526336 00000100:00100000:1.0:1788330528.216127:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330528.216142:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23413:x1875199792526336:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788330528.216240:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23413:x1875199792526336:12345-0@lo:900:osp-pre-1-1.0 Request processed in 99us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330528.216247:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788330528.216587:0:23413:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9aa00 x1875199792526336/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330544 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330528.216599:0:23413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23413:1875199792526336:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1788330528.219381:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330529.243701:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788330529.464477:0:25347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788330530.273805:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788330530.615607:0:25399:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330530.616235:0:25399:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788330530.715613:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330530.715649:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792526464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330530.715751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330530.716917:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792526464 00000100:00100000:3.0:1788330530.716936:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792526464 00000100:00100000:3.0:1788330530.717017:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330530.717030:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792526464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330530.717081:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788330530.717219:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792526464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330530.717227:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788330530.717512:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792526464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330530.718389:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330530.718410:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792526592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330530.718484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330530.718533:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792526592 00000100:00100000:2.0:1788330530.718540:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792526592 00000100:00100000:2.0:1788330530.718586:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788330530.718595:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792526592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330530.718632:0:22673:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330530.718677:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792526592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330530.718684:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788330530.718733:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792526592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330530.719357:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330530.719371:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792526720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330530.719422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330530.719478:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792526720 00000100:00100000:3.0:1788330530.719484:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792526720 00000100:00100000:3.0:1788330530.719531:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330530.719540:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792526720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330530.719569:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788330530.719610:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792526720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330530.719616:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788330530.719650:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330530.719684:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792526720:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788330531.294698:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330531.740615:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330531.740646:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792526848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330531.740739:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330531.740799:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792526848 00000100:00100000:1.0:1788330531.740808:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792526848 00000100:00100000:1.0:1788330531.740874:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330531.740886:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792526848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330531.740914:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330531.740970:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792526848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330531.740978:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330531.741050:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792526848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788330531.742240:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788330531.870881:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788330532.066592:0:25450:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788330532.066932:0:25450:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788330532.315317:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330532.401495:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.402690:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766186112 00000100:00100000:3.0:1788330532.402714:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766186112 00000100:00100000:3.0:1788330532.402792:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:3.0:1788330532.402803:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2409:x1875199766186112:12345-192.168.202.50@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788330532.402841:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 573a5691-846f-44eb-9aa6-a19751065277@192.168.202.50@tcp t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:3.0:1788330532.402897:0:22662:0:(genops.c:1385:class_connect()) connect: client 573a5691-846f-44eb-9aa6-a19751065277, cookie 0x8475908e9fd2d7c 00000100:00080000:3.0:1788330532.403075:0:22662:0:(import.c:65:import_set_state_nolock()) ffff99edc84a1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330532.403207:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+5:2409:x1875199766186112:12345-192.168.202.50@tcp:250:mount.lustre.0 Request processed in 402us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.403215:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:1.0:1788330532.426784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330532.430279:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766186240 00000100:00100000:2.0:1788330532.430304:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766186240 00000100:00100000:2.0:1788330532.430396:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:2.0:1788330532.430410:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+5:18069:x1875199766186240:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330532.430435:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330532.430461:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9039400/0x8475908e9fd2d83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106390 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330532.430499:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039400/0x8475908e9fd2d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106390 expref: 6 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330532.430525:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9039400/0x8475908e9fd2d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106390 expref: 6 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330532.430537:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039400, rc 0) 00000100:00100000:2.0:1788330532.430630:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+6:18069:x1875199766186240:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 222us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330532.430638:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:3.0:1788330532.456981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330532.458641:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766186368 00000100:00100000:0.0:1788330532.458663:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766186368 00000100:00100000:0.0:1788330532.458774:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:0.0:1788330532.458787:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+6:18069:x1875199766186368:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788330532.458978:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+6:18069:x1875199766186368:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 193us (2014us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330532.459008:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:0.0:1788330532.462336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.462426:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766186496 00000100:00100000:3.0:1788330532.462441:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766186496 00000100:00100000:3.0:1788330532.462513:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:3.0:1788330532.462525:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+6:18069:x1875199766186496:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788330532.462559:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330532.462585:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec0030200/0x8475908e9fd2d8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106397 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.462625:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec0030200/0x8475908e9fd2d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106397 expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.462639:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec0030200/0x8475908e9fd2d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106397 expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.462651:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec0030200, rc 0) 00000100:00100000:3.0:1788330532.462739:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+7:18069:x1875199766186496:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 205us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.462747:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:0.0:1788330532.465033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330532.465077:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766186624 00000100:00100000:0.0:1788330532.465087:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766186624 00000100:00100000:0.0:1788330532.465189:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:0.0:1788330532.465203:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+7:18069:x1875199766186624:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788330532.465532:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+8:18069:x1875199766186624:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 331us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330532.465542:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:2.0:1788330532.490055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.491122:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766186752 00000100:00100000:3.0:1788330532.491139:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766186752 00000100:00100000:3.0:1788330532.492428:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:3.0:1788330532.492449:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+8:18069:x1875199766186752:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788330532.493220:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+8:18069:x1875199766186752:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 772us (3177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.493231:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:3.0:1788330532.510519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330532.510957:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766186880 00000100:00100000:1.0:1788330532.510971:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766186880 00000100:00100000:1.0:1788330532.511034:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:1.0:1788330532.511046:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+8:18088:x1875199766186880:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788330532.511290:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+8:18088:x1875199766186880:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 244us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330532.511300:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:1.0:1788330532.548483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.548691:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766187008 00000100:00100000:3.0:1788330532.548706:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766187008 00000100:00100000:3.0:1788330532.548796:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:3.0:1788330532.548809:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+8:18088:x1875199766187008:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330532.549043:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+8:18088:x1875199766187008:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 236us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.549060:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:1.0:1788330532.555797:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.556045:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766187136 00000100:00100000:3.0:1788330532.556060:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766187136 00000100:00100000:3.0:1788330532.556139:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:3.0:1788330532.556213:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+8:18088:x1875199766187136:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330532.556429:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+8:18088:x1875199766187136:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 219us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.556438:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:0.0:1788330532.569303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330532.569524:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766187264 00000100:00100000:1.0:1788330532.569538:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766187264 00000100:00100000:1.0:1788330532.569616:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:1.0:1788330532.569638:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+8:18069:x1875199766187264:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788330532.569661:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330532.569685:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eeffb93400/0x8475908e9fd2d91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61063c8 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330532.569724:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeffb93400/0x8475908e9fd2d91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063c8 expref: 9 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330532.569737:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eeffb93400/0x8475908e9fd2d91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063c8 expref: 9 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330532.569747:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeffb93400, rc 0) 00000100:00100000:1.0:1788330532.569826:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+9:18069:x1875199766187264:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 192us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330532.569834:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:1.0:1788330532.574030:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330532.574363:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766187392 00000100:00100000:2.0:1788330532.574379:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766187392 00000100:00100000:2.0:1788330532.574511:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:2.0:1788330532.574526:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+9:18069:x1875199766187392:12345-192.168.202.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788330532.574564:0:22664:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788330532.574594:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788330532.574597:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788330532.574600:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788330532.574602:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788330532.574604:0:22664:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788330532.579913:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+9:18069:x1875199766187392:12345-192.168.202.50@tcp:256:mount.lustre.0 Request processed in 5374us (5882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.579934:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:0.0:1788330532.588648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330532.589010:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766187520 00000100:00100000:1.0:1788330532.589027:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766187520 00000100:00100000:1.0:1788330532.589120:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:1.0:1788330532.589133:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+9:18069:x1875199766187520:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788330532.589215:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330532.589416:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61063cf expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330532.589455:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 10 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330532.589497:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 10 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330532.589510:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeffb92200, rc 0) 00000100:00100000:1.0:1788330532.589596:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+10:18069:x1875199766187520:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 464us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330532.589603:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:1.0:1788330532.592786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.592998:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766187648 00000100:00100000:3.0:1788330532.593012:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766187648 00000100:00100000:3.0:1788330532.593086:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:3.0:1788330532.593099:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+10:18069:x1875199766187648:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788330532.595816:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+10:18069:x1875199766187648:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 2703us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330532.595835:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:2.0:1788330532.600999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.601094:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766187776 00000100:00100000:3.0:1788330532.601107:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766187776 00000100:00100000:3.0:1788330532.601209:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:3.0:1788330532.601221:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+10:18069:x1875199766187776:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788330532.601421:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+10:18069:x1875199766187776:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 202us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.601430:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:0.0:1788330532.605883:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330532.606021:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766187904 00000100:00100000:2.0:1788330532.606036:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766187904 00000100:00100000:2.0:1788330532.606106:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 128 00000100:00100000:2.0:1788330532.606130:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+10:18093:x1875199766187904:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330532.606426:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+10:18093:x1875199766187904:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 297us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330532.606436:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 128 00000100:00100000:2.0:1788330532.620574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330532.630742:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766188032 00000100:00100000:1.0:1788330532.630769:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766188032 00000100:00100000:2.0:1788330532.631040:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 129 00000100:00100000:2.0:1788330532.631055:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+10:18093:x1875199766188032:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330532.631534:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+10:18093:x1875199766188032:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 480us (10975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330532.631544:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 129 00000100:00100000:1.0:1788330532.640419:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330532.640746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330532.640850:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766188160 00000100:00100000:0.0:1788330532.640870:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766188160 00000100:00100000:0.0:1788330532.640928:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766188416 00000100:00100000:0.0:1788330532.640932:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766188416 00000100:00100000:0.0:1788330532.640949:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1788330532.640960:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2409:x1875199766188160:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788330532.641003:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f3cbf004-e5fc-4428-b2d0-a61ae201f1da@192.168.202.50@tcp t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:0.0:1788330532.641080:0:22670:0:(genops.c:1385:class_connect()) connect: client f3cbf004-e5fc-4428-b2d0-a61ae201f1da, cookie 0x8475908e9fd2d9f 00000004:00100000:0.0:1788330532.641130:0:22670:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788330532.641576:0:22670:0:(import.c:65:import_set_state_nolock()) ffff99eec43bd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330532.641680:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2409:x1875199766188160:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 719us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330532.641706:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1788330532.641730:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1788330532.641735:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2409:x1875199766188416:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788330532.641754:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f3cbf004-e5fc-4428-b2d0-a61ae201f1da@192.168.202.50@tcp t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:0.0:1788330532.641791:0:22670:0:(genops.c:1385:class_connect()) connect: client f3cbf004-e5fc-4428-b2d0-a61ae201f1da, cookie 0x8475908e9fd2da6 00000004:00100000:0.0:1788330532.641807:0:22670:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788330532.641974:0:22670:0:(import.c:65:import_set_state_nolock()) ffff99eec43be800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330532.642000:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2409:x1875199766188416:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 264us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330532.642007:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1788330532.650799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330532.650846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330532.650940:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330532.651543:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766188672 00000100:00100000:1.0:1788330532.651558:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766188672 00000100:00100000:1.0:1788330532.651644:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766188544 00000100:00100000:1.0:1788330532.651648:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766188544 00000100:00100000:1.0:1788330532.651663:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766188288 00000100:00100000:1.0:1788330532.651666:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766188288 00000100:00100000:1.0:1788330532.651680:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1788330532.651692:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18069:x1875199766188672:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788330532.651747:0:22669:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788330532.651862:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18069:x1875199766188672:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 170us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330532.651870:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1788330532.651891:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1788330532.651897:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:0:x1875199766188544:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788330532.651936:0:22669:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788330532.651974:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:0:x1875199766188544:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 77us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330532.651980:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1788330532.651993:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1788330532.652000:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:0:x1875199766188288:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788330532.652010:0:22669:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788330532.652029:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:0:x1875199766188288:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 31us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330532.652035:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00080000:0.0:1788330532.652468:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330532.652475:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330532.654826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330532.655059:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766188800 00000100:00100000:1.0:1788330532.655076:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766188800 00000100:00100000:1.0:1788330532.655323:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1788330532.655338:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18069:x1875199766188800:12345-192.168.202.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788330532.655476:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18069:x1875199766188800:12345-192.168.202.50@tcp:40:mount.lustre.0 Request processed in 141us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330532.656933:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:2.0:1788330532.659909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.660257:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766188928 00000100:00100000:3.0:1788330532.660277:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766188928 00000100:00100000:3.0:1788330532.660420:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:3.0:1788330532.660431:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2409:x1875199766188928:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788330532.660479:0:24662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f3cbf004-e5fc-4428-b2d0-a61ae201f1da@192.168.202.50@tcp t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:3.0:1788330532.660535:0:24662:0:(genops.c:1385:class_connect()) connect: client f3cbf004-e5fc-4428-b2d0-a61ae201f1da, cookie 0x8475908e9fd2dad 00002000:00100000:3.0:1788330532.660550:0:24662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f3cbf004-e5fc-4428-b2d0-a61ae201f1da/ffff99edc84a4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788330532.660572:0:24662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788330532.660810:0:24662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788330532.660852:0:24662:0:(import.c:65:import_set_state_nolock()) ffff99edc84a1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330532.660958:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2409:x1875199766188928:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 527us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.660966:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330532.664656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330532.664795:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330532.664915:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766189184 00000100:00100000:1.0:1788330532.664931:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766189184 00000100:00100000:1.0:1788330532.665074:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1788330532.665088:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18069:x1875199766189184:12345-192.168.202.50@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788330532.665252:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18069:x1875199766189184:12345-192.168.202.50@tcp:900:mount.lustre.0 Request processed in 166us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330532.665261:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1788330532.666137:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766189056 00000100:00100000:3.0:1788330532.666167:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766189056 00000100:00100000:3.0:1788330532.666215:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:3.0:1788330532.666223:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2409:x1875199766189056:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788330532.666260:0:24177:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f3cbf004-e5fc-4428-b2d0-a61ae201f1da@192.168.202.50@tcp t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:3.0:1788330532.666300:0:24177:0:(genops.c:1385:class_connect()) connect: client f3cbf004-e5fc-4428-b2d0-a61ae201f1da, cookie 0x8475908e9fd2db4 00002000:00100000:3.0:1788330532.666427:0:24177:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f3cbf004-e5fc-4428-b2d0-a61ae201f1da/ffff99edc84a4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788330532.666452:0:24177:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788330532.666711:0:24177:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788330532.666755:0:24177:0:(import.c:65:import_set_state_nolock()) ffff99edc84a6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330532.666834:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2409:x1875199766189056:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 610us (2738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.666842:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:0.0:1788330532.668610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.669074:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766189312 00000100:00100000:3.0:1788330532.669089:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766189312 00000100:00100000:3.0:1788330532.669435:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1788330532.669448:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18069:x1875199766189312:12345-192.168.202.50@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788330532.671269:0:22671:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1674us 00000004:00200000:0.0:1788330532.692795:0:22671:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788330532.692983:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18069:x1875199766189312:12345-192.168.202.50@tcp:33:mount.lustre.0 Request processed in 23527us (24376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330532.693004:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:0.0:1788330532.874785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330532.874899:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766189440 00000100:00100000:3.0:1788330532.874913:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766189440 00000100:00100000:3.0:1788330532.875044:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330532.875060:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18116:x1875199766189440:12345-192.168.202.50@tcp:101:mkdir.0 00010000:00010000:3.0:1788330532.875092:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330532.875127:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030000/0x8475908e9fd2dbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106400 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.875278:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030c00/0x8475908e9fd2dc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.875298:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030c00/0x8475908e9fd2dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.875329:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030c00/0x8475908e9fd2dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330532.875398:0:22670:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788330532.875402:0:22670:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330532.875452:0:22670:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030c00/0x8475908e9fd2dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.875700:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030000/0x8475908e9fd2dbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106400 expref: 8 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.875754:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030c00/0x8475908e9fd2dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106400 expref: 7 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330532.875765:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc757f900) 00010000:00010000:3.0:1788330532.875768:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330532.875772:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec0030c00, rc 0) 00000100:00100000:3.0:1788330532.875865:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18116:x1875199766189440:12345-192.168.202.50@tcp:101:mkdir.0 Request processed in 809us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330532.875874:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330533.275795:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330533.275829:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792526976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330533.275938:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.276381:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792527232:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.276423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.276453:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792527744:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.276483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.276503:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792528256:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.276530:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.276551:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788330533.276557:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3647:1875199792527104:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.276589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.276609:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792527616:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.276635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.276654:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792528128:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.276690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.276741:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792527232 00000100:00100000:2.0:1788330533.276751:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792527232 00000100:00100000:2.0:1788330533.276813:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792527616 00000100:00100000:2.0:1788330533.276817:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792527616 00000100:00100000:2.0:1788330533.276839:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788330533.276850:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792527232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.276919:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792527232:12345-0@lo:400:kworker.0 Request processed in 70us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.276928:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788330533.276949:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788330533.276955:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792527616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.276983:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792527616:12345-0@lo:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.276989:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788330533.277009:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792527744 00000100:00100000:2.0:1788330533.277013:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792527744 00000100:00100000:2.0:1788330533.277050:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330533.277070:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792527744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277103:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792527744:12345-0@lo:400:kworker.0 Request processed in 47us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.277109:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330533.277149:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792528256 00000100:00100000:2.0:1788330533.277185:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792528256 00000100:00100000:2.0:1788330533.277213:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792528128 00000100:00100000:2.0:1788330533.277216:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792528128 00000100:00100000:2.0:1788330533.277232:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788330533.277239:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792528256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277281:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792528256:12345-0@lo:400:kworker.0 Request processed in 43us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.277288:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788330533.277300:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788330533.277307:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792528128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277334:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792528128:12345-0@lo:400:kworker.0 Request processed in 28us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.277340:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788330533.277362:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792527360:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.277413:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792527872:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.277449:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792528384:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.277496:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788330533.277503:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792527488:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.277539:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792528000:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277559:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.277571:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792528512:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330533.277638:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792527616:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277654:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792528128:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277664:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792527232:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277686:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792527744:0@lo:400:kworker.0 00010000:00080000:2.0:1788330533.277699:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8451500 x1875199792528256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330533.277711:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792528256:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277748:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792528384 00000100:00100000:2.0:1788330533.277752:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792528384 00000100:00100000:2.0:1788330533.277772:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792527488 00000100:00100000:2.0:1788330533.277775:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792527488 00000100:00100000:2.0:1788330533.277784:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792528000 00000100:00100000:2.0:1788330533.277786:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792528000 00000100:00100000:2.0:1788330533.277797:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792528512 00000100:00100000:2.0:1788330533.277799:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792528512 00000100:00100000:2.0:1788330533.277815:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788330533.277821:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792528384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277880:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792528384:12345-0@lo:400:kworker.0 Request processed in 58us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.277887:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788330533.277901:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330533.277908:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792527488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277937:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792527488:12345-0@lo:400:kworker.0 Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.277943:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330533.277956:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788330533.277961:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792528000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.277987:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792528000:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.278003:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788330533.278015:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788330533.278021:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792528512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.278050:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792528512:12345-0@lo:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330533.278056:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788330533.278082:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792527488:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.278092:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792528000:0@lo:400:kworker.0 00010000:00080000:2.0:1788330533.278102:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8451880 x1875199792528512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330533.278111:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792528512:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.278123:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792528384:0@lo:400:kworker.0 00000100:00100000:1.0:1788330533.278531:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792526976 00000100:00100000:1.0:1788330533.278539:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792526976 00000100:00100000:1.0:1788330533.278596:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330533.278604:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792526976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330533.278626:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788330533.278680:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792526976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330533.278688:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330533.278752:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792526976:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788330533.278978:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330533.278986:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330533.278989:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330533.279002:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330533.279018:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792527360 00000100:00100000:0.0:1788330533.279023:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792527360 00000100:00100000:0.0:1788330533.279072:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792527872 00000100:00100000:0.0:1788330533.279076:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792527872 00000100:00100000:0.0:1788330533.279096:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330533.279104:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792527360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330533.279198:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792527360:12345-0@lo:400:kworker.0 Request processed in 95us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330533.279205:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330533.279223:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330533.279230:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875199792527872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330533.279280:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875199792527872:12345-0@lo:400:kworker.0 Request processed in 50us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330533.279287:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788330533.279303:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330533.279306:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330533.279319:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330533.279335:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792528640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330533.279375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330533.280560:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792527104 00000100:00100000:3.0:1788330533.280577:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792527104 00000100:00100000:3.0:1788330533.280653:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788330533.280665:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3647:x1875199792527104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330533.280772:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3647:x1875199792527104:12345-0@lo:400:kworker.0 Request processed in 111us (4182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330533.280780:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788330533.284545:0:24180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792528640 00000100:00100000:2.0:1788330533.284566:0:24180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792528640 00000100:00100000:2.0:1788330533.284630:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330533.284645:0:24180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875199792528640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330533.284686:0:24180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788330533.285389:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792527360:0@lo:400:kworker.0 00000100:00100000:1.0:1788330533.285414:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792527872:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.286706:0:24180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875199792528640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2054us (7320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330533.286889:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792528640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330533.286904:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3647:1875199792527104:0@lo:400:kworker.0 00000100:00100000:2.0:1788330533.286996:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788330533.339514:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788330533.793479:0:24990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f3cbf004-e5fc-4428-b2d0-a61ae201f1da 00000001:00080000:2.0:1788330533.793506:0:24990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1788330534.363901:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330534.807080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330534.807302:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766189568 00000100:00100000:2.0:1788330534.807334:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766189568 00000100:00100000:2.0:1788330534.807446:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:2.0:1788330534.807460:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18168:x1875199766189568:12345-192.168.202.50@tcp:41:lfs.0 00000004:00000024:2.0:1788330534.807522:0:22668:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788330534.807641:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18168:x1875199766189568:12345-192.168.202.50@tcp:41:lfs.0 Request processed in 184us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330534.807650:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00080000:0.0:1788330534.808098:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330534.812991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330534.813303:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766189696 00000100:00100000:3.0:1788330534.813318:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766189696 00000100:00100000:3.0:1788330534.813409:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1788330534.813422:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18168:x1875199766189696:12345-192.168.202.50@tcp:41:lfs.0 00000004:00000024:3.0:1788330534.813505:0:22670:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788330534.813637:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18168:x1875199766189696:12345-192.168.202.50@tcp:41:lfs.0 Request processed in 217us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330534.813647:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00080000:0.0:1788330534.816463:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330534.817262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330534.818843:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766189824 00000100:00100000:1.0:1788330534.818863:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766189824 00000100:00100000:1.0:1788330534.819053:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1788330534.819067:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18168:x1875199766189824:12345-192.168.202.50@tcp:13:lfs.0 00002000:00000024:1.0:1788330534.819115:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330534.819302:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18168:x1875199766189824:12345-192.168.202.50@tcp:13:lfs.0 Request processed in 238us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330534.819312:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1788330534.822849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330534.822973:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766189952 00000100:00100000:2.0:1788330534.822986:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766189952 00000100:00080000:0.0:1788330534.823235:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330534.823242:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330534.824111:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:2.0:1788330534.824139:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:18168:x1875199766189952:12345-192.168.202.50@tcp:13:lfs.0 00002000:00000024:2.0:1788330534.824210:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788330534.824345:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:18168:x1875199766189952:12345-192.168.202.50@tcp:13:lfs.0 Request processed in 221us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330534.824360:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:3.0:1788330535.056561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.057486:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766190080 00000100:00100000:2.0:1788330535.057503:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766190080 00000100:00100000:2.0:1788330535.057588:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:2.0:1788330535.057601:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+10:18201:x1875199766190080:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330535.057626:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330535.057651:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038400/0x8475908e9fd2dc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106407 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.057691:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038400/0x8475908e9fd2dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106407 expref: 11 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.057735:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038400/0x8475908e9fd2dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106407 expref: 11 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.057748:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038400, rc 0) 00000100:00100000:2.0:1788330535.057837:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+11:18201:x1875199766190080:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 238us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.057844:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:1.0:1788330535.066589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.066839:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766190208 00000100:00100000:0.0:1788330535.066853:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766190208 00000100:00100000:0.0:1788330535.066936:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 132 00000100:00100000:0.0:1788330535.066951:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+11:18201:x1875199766190208:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788330535.067247:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+11:18201:x1875199766190208:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 298us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.067257:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 132 00000100:00100000:1.0:1788330535.072631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330535.072792:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766190336 00000100:00100000:3.0:1788330535.072808:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766190336 00000100:00100000:3.0:1788330535.072889:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:3.0:1788330535.072901:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+11:18201:x1875199766190336:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788330535.073106:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+11:18201:x1875199766190336:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 207us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330535.073116:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:3.0:1788330535.078929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.079419:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766190464 00000100:00100000:2.0:1788330535.079434:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766190464 00000100:00100000:2.0:1788330535.079509:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 134 00000100:00100000:2.0:1788330535.079522:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+11:18208:x1875199766190464:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330535.079838:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+11:18208:x1875199766190464:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 318us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.079848:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 134 00000100:00100000:1.0:1788330535.104410:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.104618:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766190592 00000100:00100000:0.0:1788330535.104634:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766190592 00000100:00100000:0.0:1788330535.104704:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:0.0:1788330535.104714:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+11:18208:x1875199766190592:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330535.104905:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+11:18208:x1875199766190592:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 192us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.104911:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:1.0:1788330535.116909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.117030:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766190720 00000100:00100000:2.0:1788330535.117053:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766190720 00000100:00100000:2.0:1788330535.117133:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:2.0:1788330535.117145:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+11:18208:x1875199766190720:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330535.117390:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+11:18208:x1875199766190720:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 246us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.117399:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:1.0:1788330535.127483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330535.128182:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766190848 00000100:00100000:3.0:1788330535.128194:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766190848 00000100:00100000:3.0:1788330535.128259:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:3.0:1788330535.128269:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+11:18201:x1875199766190848:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788330535.128289:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330535.128312:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec0030000/0x8475908e9fd2dd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106438 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330535.128360:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec0030000/0x8475908e9fd2dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106438 expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330535.128372:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec0030000/0x8475908e9fd2dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106438 expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330535.128391:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec0030000, rc 0) 00000100:00100000:3.0:1788330535.128458:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+12:18201:x1875199766190848:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 190us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330535.128466:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:1.0:1788330535.134473:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.134545:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766190976 00000100:00100000:0.0:1788330535.134559:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766190976 00000100:00100000:0.0:1788330535.134648:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 138 00000100:00100000:0.0:1788330535.134662:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+12:18201:x1875199766190976:12345-192.168.202.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788330535.134699:0:22664:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788330535.134754:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788330535.134761:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788330535.134767:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788330535.134774:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788330535.134776:0:22664:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788330535.137269:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+12:18201:x1875199766190976:12345-192.168.202.50@tcp:256:mount.lustre.0 Request processed in 2592us (2795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.137288:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 138 00000100:00100000:1.0:1788330535.139957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.140062:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766191104 00000100:00100000:2.0:1788330535.140075:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766191104 00000100:00100000:2.0:1788330535.140146:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00100000:2.0:1788330535.140213:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+12:18201:x1875199766191104:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330535.140251:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330535.140273:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610643f expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.140707:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.140722:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.140733:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039200, rc 0) 00000100:00100000:2.0:1788330535.140805:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+13:18201:x1875199766191104:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 595us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.140813:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00100000:1.0:1788330535.148745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.149232:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766191232 00000100:00100000:0.0:1788330535.149249:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766191232 00000100:00100000:0.0:1788330535.149335:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 140 00000100:00100000:0.0:1788330535.149356:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+13:18201:x1875199766191232:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788330535.149600:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+13:18201:x1875199766191232:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 253us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.149608:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 140 00000100:00100000:1.0:1788330535.154628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.154835:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766191360 00000100:00100000:2.0:1788330535.154851:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766191360 00000100:00100000:2.0:1788330535.154932:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:2.0:1788330535.154946:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+13:18201:x1875199766191360:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788330535.155145:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+13:18201:x1875199766191360:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 202us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.155184:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:1.0:1788330535.160858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330535.161329:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766191488 00000100:00100000:3.0:1788330535.161346:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766191488 00000100:00100000:3.0:1788330535.161433:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:3.0:1788330535.161447:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+13:18213:x1875199766191488:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330535.161669:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+13:18213:x1875199766191488:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 225us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330535.161679:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:1.0:1788330535.175459:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.175650:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766191616 00000100:00100000:0.0:1788330535.175665:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766191616 00000100:00100000:0.0:1788330535.175749:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:0.0:1788330535.175763:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+13:18213:x1875199766191616:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330535.175989:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+13:18213:x1875199766191616:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 229us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.175999:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:1.0:1788330535.181887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330535.181943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.182275:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766191744 00000100:00100000:0.0:1788330535.182290:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766191744 00000100:00100000:0.0:1788330535.182530:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766192000 00000100:00100000:0.0:1788330535.182535:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766192000 00000100:00100000:2.0:1788330535.187402:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1788330535.187424:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2409:x1875199766191744:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788330535.187478:0:22668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bec507ff-147a-4857-b92c-687ebb3aca56@192.168.202.50@tcp t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:2.0:1788330535.187556:0:22668:0:(genops.c:1385:class_connect()) connect: client bec507ff-147a-4857-b92c-687ebb3aca56, cookie 0x8475908e9fd2dde 00000004:00100000:2.0:1788330535.187681:0:22668:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788330535.187856:0:22668:0:(import.c:65:import_set_state_nolock()) ffff99edc7f3e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330535.187960:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:2409:x1875199766191744:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 538us (6088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.187970:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1788330535.188008:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1788330535.188014:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2409:x1875199766192000:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788330535.188035:0:22668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from bec507ff-147a-4857-b92c-687ebb3aca56@192.168.202.50@tcp t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:2.0:1788330535.188295:0:22668:0:(genops.c:1385:class_connect()) connect: client bec507ff-147a-4857-b92c-687ebb3aca56, cookie 0x8475908e9fd2de5 00000004:00100000:2.0:1788330535.188314:0:22668:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788330535.188369:0:22668:0:(import.c:65:import_set_state_nolock()) ffff99edc7f3e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330535.188399:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:2409:x1875199766192000:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 383us (6455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.188407:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:1.0:1788330535.206289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330535.206336:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.206762:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766192128 00000100:00100000:0.0:1788330535.206776:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766192128 00000100:00100000:0.0:1788330535.206870:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766191872 00000100:00100000:0.0:1788330535.206874:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766191872 00000100:00100000:0.0:1788330535.206898:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:0.0:1788330535.206910:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+6:0:x1875199766192128:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788330535.206964:0:22670:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330535.207065:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+6:0:x1875199766192128:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 157us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.207094:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:0.0:1788330535.207116:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1788330535.207316:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+6:0:x1875199766191872:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788330535.207337:0:22670:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788330535.207371:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+6:0:x1875199766191872:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 218us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.207377:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00080000:1.0:1788330535.207799:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330535.207805:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330535.211750:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.213247:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766192256 00000100:00100000:0.0:1788330535.213268:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766192256 00000100:00100000:0.0:1788330535.213412:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330535.213427:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+6:18201:x1875199766192256:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788330535.213469:0:22670:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788330535.213583:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+6:18201:x1875199766192256:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 159us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.213592:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:1.0:1788330535.237633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330535.237741:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766192384 00000100:00100000:3.0:1788330535.237755:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766192384 00000100:00100000:3.0:1788330535.237831:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:3.0:1788330535.237844:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bec507ff-147a-4857-b92c-687ebb3aca56+6:18201:x1875199766192384:12345-192.168.202.50@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788330535.237963:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bec507ff-147a-4857-b92c-687ebb3aca56+6:18201:x1875199766192384:12345-192.168.202.50@tcp:40:mount.lustre.0 Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330535.237971:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1788330535.242815:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330535.242868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330535.242904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.243013:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766192512 00000100:00100000:0.0:1788330535.243026:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766192512 00000100:00100000:0.0:1788330535.243075:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766192640 00000100:00100000:0.0:1788330535.243077:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766192640 00000100:00100000:0.0:1788330535.243094:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:0.0:1788330535.243103:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875199766192512:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788330535.243190:0:24176:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bec507ff-147a-4857-b92c-687ebb3aca56@192.168.202.50@tcp t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:0.0:1788330535.243236:0:24176:0:(genops.c:1385:class_connect()) connect: client bec507ff-147a-4857-b92c-687ebb3aca56, cookie 0x8475908e9fd2dec 00002000:00100000:0.0:1788330535.243250:0:24176:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bec507ff-147a-4857-b92c-687ebb3aca56/ffff99eec43b9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788330535.243281:0:24176:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788330535.243369:0:24176:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788330535.243407:0:24176:0:(import.c:65:import_set_state_nolock()) ffff99eec43b9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330535.243490:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:2409:x1875199766192512:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 386us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.243499:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:0.0:1788330535.243522:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1788330535.243527:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875199766192640:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788330535.243544:0:24176:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bec507ff-147a-4857-b92c-687ebb3aca56@192.168.202.50@tcp t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:0.0:1788330535.243562:0:24176:0:(genops.c:1385:class_connect()) connect: client bec507ff-147a-4857-b92c-687ebb3aca56, cookie 0x8475908e9fd2df3 00002000:00100000:0.0:1788330535.243567:0:24176:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bec507ff-147a-4857-b92c-687ebb3aca56/ffff99eec43bc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788330535.243574:0:24176:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788330535.243627:0:24176:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788330535.243643:0:24176:0:(import.c:65:import_set_state_nolock()) ffff99eec43bd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330535.243668:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:2409:x1875199766192640:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 139us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.243674:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1788330535.244699:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766192768 00000100:00100000:2.0:1788330535.244713:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766192768 00000100:00100000:2.0:1788330535.244779:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1788330535.244789:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bec507ff-147a-4857-b92c-687ebb3aca56+6:18201:x1875199766192768:12345-192.168.202.50@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788330535.244868:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bec507ff-147a-4857-b92c-687ebb3aca56+6:18201:x1875199766192768:12345-192.168.202.50@tcp:900:mount.lustre.0 Request processed in 81us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.244876:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1788330535.244999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330535.245102:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330535.245137:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766193280 00000100:00100000:3.0:1788330535.245141:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766193280 00000100:00100000:3.0:1788330535.245208:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:3.0:1788330535.245217:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2412:x1875199766193280:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330535.245273:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2412:x1875199766193280:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 57us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.245531:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766193024 00000100:00100000:2.0:1788330535.245536:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766193024 00000100:00100000:2.0:1788330535.245570:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1788330535.245578:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:2412:x1875199766193024:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330535.245610:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:2412:x1875199766193024:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 33us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.245624:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1788330535.245685:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.245703:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766193536 00000100:00100000:2.0:1788330535.245707:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766193536 00000100:00100000:2.0:1788330535.245730:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:2.0:1788330535.245737:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:2412:x1875199766193536:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330535.245785:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:2412:x1875199766193536:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 48us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.245792:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:2.0:1788330535.245849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.245884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.245898:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766193152 00000100:00100000:2.0:1788330535.245902:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766193152 00000100:00100000:2.0:1788330535.245923:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:2.0:1788330535.245930:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2412:x1875199766193152:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330535.245956:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2412:x1875199766193152:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.245963:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:2.0:1788330535.246008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.246099:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766193408 00000100:00100000:2.0:1788330535.246103:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766193408 00000100:00100000:3.0:1788330535.246234:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:2.0:1788330535.249314:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1788330535.249355:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2412:x1875199766193408:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330535.249485:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2412:x1875199766193408:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 154us (3476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.249520:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1788330535.249569:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766192896 00000100:00100000:2.0:1788330535.249579:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766192896 00000100:00100000:2.0:1788330535.249617:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:2.0:1788330535.249623:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+13:2412:x1875199766192896:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330535.249651:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+13:2412:x1875199766192896:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.249657:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:3.0:1788330535.250628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330535.251047:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766193664 00000100:00100000:0.0:1788330535.251059:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766193664 00000100:00100000:0.0:1788330535.251114:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:0.0:1788330535.251135:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bec507ff-147a-4857-b92c-687ebb3aca56+6:18201:x1875199766193664:12345-192.168.202.50@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788330535.251293:0:22672:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788330535.251379:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bec507ff-147a-4857-b92c-687ebb3aca56+6:18201:x1875199766193664:12345-192.168.202.50@tcp:33:mount.lustre.0 Request processed in 246us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330535.251405:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00010000:00010000:0.0:1788330535.387833:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330535.460945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330535.461078:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766193792 00000100:00100000:2.0:1788330535.461092:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766193792 00000100:00100000:2.0:1788330535.461285:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1788330535.461299:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+6:18236:x1875199766193792:12345-192.168.202.50@tcp:101:mkdir.0 00010000:00010000:2.0:1788330535.461329:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330535.461376:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd2dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106470 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.461467:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.461502:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.461529:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330535.461590:0:22670:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330535.461594:0:22670:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330535.461641:0:22670:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.461678:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd2dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 8 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.461720:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 7 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330535.461732:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc757f900) 00010000:00010000:2.0:1788330535.461735:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330535.461740:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039800, rc 0) 00000100:00100000:2.0:1788330535.461826:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+7:18236:x1875199766193792:12345-192.168.202.50@tcp:101:mkdir.0 Request processed in 530us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.461834:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:1.0:1788330535.835531:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330535.835568:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792528768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330535.835678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330535.835841:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792528768 00000100:00100000:2.0:1788330535.835853:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792528768 00000100:00100000:2.0:1788330535.835936:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788330535.835951:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792528768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330535.835997:0:22674:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330535.836068:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792528768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330535.836077:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788330535.836181:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792528768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330535.838196:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330535.838235:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792528896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330535.838338:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330535.838727:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792528896 00000100:00100000:3.0:1788330535.838740:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792528896 00000100:00100000:3.0:1788330535.838817:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330535.838830:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792528896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330535.838869:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788330535.838942:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792528896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330535.838949:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788330535.839104:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792528896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330535.839299:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330535.839314:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792529024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330535.839356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330535.839500:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792529024 00000100:00100000:1.0:1788330535.839506:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792529024 00000100:00100000:1.0:1788330535.839567:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330535.839577:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792529024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330535.839594:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330535.839639:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792529024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330535.839657:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788330535.839711:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330535.839767:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792529024:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788330536.411383:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330536.867511:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792529152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330536.867626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330536.867717:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792529152 00000100:00100000:2.0:1788330536.867730:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792529152 00000100:00100000:2.0:1788330536.867829:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330536.867843:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792529152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330536.867886:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788330536.867942:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792529152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330536.867950:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788330536.870226:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330536.870329:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792529152:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788330537.435448:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330537.819860:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1788330537.885967:0:24172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bec507ff-147a-4857-b92c-687ebb3aca56 00000001:00100000:3.0:1788330537.885985:0:24172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f3cbf004-e5fc-4428-b2d0-a61ae201f1da 00000001:00100000:3.0:1788330537.886010:0:22649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bec507ff-147a-4857-b92c-687ebb3aca56 00000001:00100000:3.0:1788330537.886016:0:22649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f3cbf004-e5fc-4428-b2d0-a61ae201f1da 00000001:00100000:2.0:1788330537.897538:0:23402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bec507ff-147a-4857-b92c-687ebb3aca56 00000001:00100000:2.0:1788330537.897557:0:23402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f3cbf004-e5fc-4428-b2d0-a61ae201f1da 00000100:00100000:2.0:1788330538.397147:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792529408:0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.397700:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792529280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330538.404000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330538.404126:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792529792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.404198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330538.404222:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792530304:0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.404247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330538.404402:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792530816:0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.404434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330538.404477:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788330538.404882:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792529664:0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.404914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330538.404949:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792530176:0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.404995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330538.405027:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792530688:0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.405053:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330538.405124:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792530816 00000100:00100000:0.0:1788330538.405135:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792530816 00000100:00100000:0.0:1788330538.405223:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792530688 00000100:00100000:0.0:1788330538.405227:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792530688 00000100:00100000:0.0:1788330538.405249:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788330538.405442:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792529792 00000100:00100000:1.0:1788330538.405448:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792529792 00000100:00100000:1.0:1788330538.405475:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792530304 00000100:00100000:1.0:1788330538.405478:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792530304 00000100:00100000:3.0:1788330538.406174:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792529664 00000100:00100000:3.0:1788330538.406182:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792529664 00000100:00100000:3.0:1788330538.406211:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792530176 00000100:00100000:3.0:1788330538.406214:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792530176 00000100:00100000:3.0:1788330538.406233:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330538.406244:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792529792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330538.406361:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792529792:12345-0@lo:400:kworker.0 Request processed in 118us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330538.406382:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330538.406404:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330538.406410:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792529664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330538.406444:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792529664:12345-0@lo:400:kworker.0 Request processed in 34us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330538.406450:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330538.406465:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330538.406471:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792530176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330538.406517:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792530176:12345-0@lo:400:kworker.0 Request processed in 46us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330538.406524:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330538.406716:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792529664:0@lo:400:kworker.0 00000100:00100000:3.0:1788330538.406730:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792530176:0@lo:400:kworker.0 00000100:00100000:3.0:1788330538.406742:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792529792:0@lo:400:kworker.0 00000100:00100000:1.0:1788330538.407196:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330538.407206:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792530304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330538.407435:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792530304:12345-0@lo:400:kworker.0 Request processed in 229us (3185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330538.407444:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330538.407480:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788330538.407581:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792530304:0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.407898:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792530816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.407958:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792530816:12345-0@lo:400:kworker.0 Request processed in 68us (3523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330538.407965:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788330538.407988:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788330538.407995:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792530688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.408028:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792530688:12345-0@lo:400:kworker.0 Request processed in 34us (2974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330538.408034:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788330538.408066:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330538.408074:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330538.408078:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330538.408080:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788330538.408208:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8453100 x1875199792530688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330538.408221:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792530688:0@lo:400:kworker.0 00000100:00100000:1.0:1788330538.408241:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792530816:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.408446:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330538.408890:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792529280 00000100:00100000:2.0:1788330538.408900:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792529280 00000100:00100000:0.0:1788330538.409433:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792529408 00000100:00100000:0.0:1788330538.409439:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792529408 00000100:00100000:0.0:1788330538.409480:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788330538.409629:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3648:x1875199792529408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330538.409708:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3648:x1875199792529408:12345-0@lo:400:kworker.0 Request processed in 84us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330538.410082:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788330538.410103:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792529280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330538.410140:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788330538.410401:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788330538.411578:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792529536:0@lo:400:kworker.0 00000100:00100000:3.0:1788330538.411657:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330538.411930:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792529280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1837us (7942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330538.411941:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788330538.412073:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792529280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330538.412400:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792529408:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.412413:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792529920:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.412447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330538.412871:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792530048:0@lo:400:kworker.0 00000100:00100000:3.0:1788330538.412901:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330538.412936:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792529920 00000100:00100000:2.0:1788330538.412944:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792529920 00000100:00100000:2.0:1788330538.412988:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788330538.412998:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792529920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.413045:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792529920:12345-0@lo:400:kworker.0 Request processed in 49us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330538.413052:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788330538.413080:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792529920:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.413100:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792530432:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.413125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330538.413142:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792530944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.413189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330538.413207:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792530432 00000100:00100000:2.0:1788330538.413211:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792530432 00000100:00100000:2.0:1788330538.413227:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792530944 00000100:00100000:2.0:1788330538.413230:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792530944 00000100:00100000:2.0:1788330538.413261:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788330538.413268:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792530432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.413299:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792530432:12345-0@lo:400:kworker.0 Request processed in 31us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330538.413304:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788330538.413318:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788330538.413324:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792530944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.413350:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792530944:12345-0@lo:400:kworker.0 Request processed in 26us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330538.413356:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788330538.413385:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788330538.413407:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8451500 x1875199792530944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330538.413420:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792530944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.413455:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792530432:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.429692:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792530560:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.429810:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330538.429848:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792530560 00000100:00100000:2.0:1788330538.429858:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792530560 00000100:00100000:2.0:1788330538.429939:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788330538.429952:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792530560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.430019:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792530560:12345-0@lo:400:kworker.0 Request processed in 69us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330538.430028:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788330538.430054:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330538.430105:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792530560:0@lo:400:kworker.0 00000100:00100000:2.0:1788330538.430116:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792531072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330538.430206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330538.430232:0:24180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792531072 00000100:00100000:2.0:1788330538.430236:0:24180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792531072 00000100:00100000:2.0:1788330538.430264:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330538.430271:0:24180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792531072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330538.430292:0:24180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788330538.430343:0:24180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792531072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330538.430361:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330538.430404:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792531072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330538.438823:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792529536 00000100:00100000:1.0:1788330538.438847:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792529536 00000100:00100000:1.0:1788330538.438983:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792530048 00000100:00100000:1.0:1788330538.438987:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792530048 00000100:00100000:1.0:1788330538.439022:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788330538.439036:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792529536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330538.439248:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792529536:12345-0@lo:400:kworker.0 Request processed in 215us (27591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330538.439817:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788330538.439873:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788330538.439881:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792530048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330538.439931:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792530048:12345-0@lo:400:kworker.0 Request processed in 51us (27029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330538.439938:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788330538.440011:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792529536:0@lo:400:kworker.0 00000100:00100000:1.0:1788330538.440025:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792530048:0@lo:400:kworker.0 00010000:00010000:2.0:1788330538.460460:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788330538.963766:0:25548:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788330539.483418:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330540.269623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330540.269675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330540.269721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330540.269763:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330540.269788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330540.269875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330540.269913:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766194048 00000100:00100000:1.0:1788330540.269924:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766194048 00000100:00100000:1.0:1788330540.269994:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766194176 00000100:00100000:1.0:1788330540.269998:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766194176 00000100:00100000:1.0:1788330540.270011:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766194560 00000100:00100000:1.0:1788330540.270014:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766194560 00000100:00100000:1.0:1788330540.270045:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:1.0:1788330540.270056:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2411:x1875199766194048:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330540.270314:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2411:x1875199766194048:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 258us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330540.270323:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:1.0:1788330540.270449:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:1.0:1788330540.270457:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2411:x1875199766194176:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330540.270508:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2411:x1875199766194176:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 52us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330540.270515:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:1.0:1788330540.270528:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:1.0:1788330540.270535:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:2411:x1875199766194560:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330540.270560:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:2411:x1875199766194560:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330540.270566:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:1.0:1788330540.270587:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766194304 00000100:00100000:1.0:1788330540.270592:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766194304 00000100:00100000:1.0:1788330540.270621:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766194432 00000100:00100000:1.0:1788330540.270624:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766194432 00000100:00100000:1.0:1788330540.270648:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:1.0:1788330540.270655:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2411:x1875199766194304:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330540.270683:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2411:x1875199766194304:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330540.270690:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:1.0:1788330540.270702:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:1.0:1788330540.270709:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2411:x1875199766194432:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330540.270735:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2411:x1875199766194432:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330540.270742:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00080000:1.0:1788330540.270770:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330540.270775:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330540.270778:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330540.270787:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330540.271351:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766193920 00000100:00100000:0.0:1788330540.271358:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766193920 00000100:00100000:0.0:1788330540.271403:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 146 00000100:00100000:0.0:1788330540.271411:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+13:2411:x1875199766193920:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330540.271454:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+13:2411:x1875199766193920:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 44us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330540.271460:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 146 00000100:00100000:1.0:1788330540.272778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330540.272927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330540.272969:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330540.273058:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766194688 00000100:00100000:0.0:1788330540.273068:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766194688 00000100:00100000:0.0:1788330540.273144:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:0.0:1788330540.273172:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+5:2411:x1875199766194688:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330540.273243:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+5:2411:x1875199766194688:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 91us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330540.273251:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00080000:0.0:1788330540.277047:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330540.277549:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766194816 00000100:00100000:3.0:1788330540.277566:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766194816 00000100:00100000:3.0:1788330540.277641:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766194944 00000100:00100000:3.0:1788330540.277646:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766194944 00000100:00100000:3.0:1788330540.277677:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:3.0:1788330540.277689:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bec507ff-147a-4857-b92c-687ebb3aca56+5:2411:x1875199766194816:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330540.278019:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bec507ff-147a-4857-b92c-687ebb3aca56+5:2411:x1875199766194816:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 330us (5090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330540.278028:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:3.0:1788330540.278046:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:3.0:1788330540.278053:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefef74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bec507ff-147a-4857-b92c-687ebb3aca56+6:2411:x1875199766194944:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330540.278095:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefef74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bec507ff-147a-4857-b92c-687ebb3aca56+6:2411:x1875199766194944:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 41us (5126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330540.278102:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00080000:0.0:1788330540.278119:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330540.278126:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788330540.512403:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330540.955597:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792531200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330540.955673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330540.956043:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792531200 00000100:00100000:1.0:1788330540.956051:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792531200 00000100:00100000:1.0:1788330540.956110:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788330540.956120:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792531200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330540.956182:0:22673:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788330540.956241:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792531200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330540.956249:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788330540.956278:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792531328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330540.956307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330540.956341:0:24180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792531328 00000100:00100000:1.0:1788330540.956344:0:24180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792531328 00000100:00100000:1.0:1788330540.956382:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788330540.956389:0:24180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792531328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330540.956407:0:24180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330540.956443:0:24180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792531328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330540.956449:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788330540.956492:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792531328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330540.956523:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792531200:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788330540.957496:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330540.958131:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792531456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330540.958221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330540.958564:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792531456 00000100:00100000:3.0:1788330540.958573:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792531456 00000100:00100000:3.0:1788330540.958618:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330540.958627:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792531456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330540.958656:0:23671:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788330540.958714:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792531456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330540.958722:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788330540.958808:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792531456:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788330540.962575:0:24990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bec507ff-147a-4857-b92c-687ebb3aca56 00000040:00080000:1.0:1788330541.084923:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330541.531480:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330541.988544:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330541.988567:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792531584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330541.988638:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330541.988689:0:24180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792531584 00000100:00100000:1.0:1788330541.988696:0:24180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792531584 00000100:00100000:1.0:1788330541.988748:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788330541.988756:0:24180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792531584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330541.988776:0:24180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330541.988819:0:24180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792531584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330541.988826:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788330541.988846:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330541.988877:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792531584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788330542.557325:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330543.516203:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792531712:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516326:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792532224:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516371:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792532736:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516407:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792533248:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516456:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788330543.516462:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792531840:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516486:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516503:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792532352:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516535:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792532864:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516573:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792531968:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516594:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516609:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792532480:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516627:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516643:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792532992:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516672:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788330543.516677:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792532096:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516713:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792532608:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516730:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516745:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792533120:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330543.516790:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792531712 00000100:00100000:3.0:1788330543.516797:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792531712 00000100:00100000:3.0:1788330543.516844:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788330543.516854:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3646:x1875199792531712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.516903:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3646:x1875199792531712:12345-0@lo:400:kworker.0 Request processed in 50us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.516930:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788330543.516963:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792532224 00000100:00100000:3.0:1788330543.516967:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792532224 00000100:00100000:3.0:1788330543.516984:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792532736 00000100:00100000:3.0:1788330543.516987:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792532736 00000100:00100000:3.0:1788330543.516996:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792533248 00000100:00100000:3.0:1788330543.516999:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792533248 00000100:00100000:3.0:1788330543.517018:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792532864 00000100:00100000:3.0:1788330543.517021:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792532864 00000100:00100000:3.0:1788330543.517031:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792532992 00000100:00100000:3.0:1788330543.517033:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792532992 00000100:00100000:3.0:1788330543.517058:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792533120 00000100:00100000:3.0:1788330543.517062:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792533120 00000100:00100000:3.0:1788330543.517075:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330543.517081:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792532224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517114:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792532224:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517120:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330543.517133:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788330543.517139:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792532736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517188:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792532736:12345-0@lo:400:kworker.0 Request processed in 49us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517194:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788330543.517207:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330543.517213:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792533248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517239:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792533248:12345-0@lo:400:kworker.0 Request processed in 27us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517244:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330543.517265:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788330543.517270:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792532864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517298:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792532864:12345-0@lo:400:kworker.0 Request processed in 28us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517304:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788330543.517316:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330543.517321:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792532992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517351:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792532992:12345-0@lo:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517357:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330543.517367:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788330543.517373:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792533120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517396:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792533120:12345-0@lo:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517402:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788330543.517430:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792531840 00000100:00100000:3.0:1788330543.517434:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792531840 00000100:00100000:3.0:1788330543.517458:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792532352 00000100:00100000:3.0:1788330543.517461:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792532352 00000100:00100000:3.0:1788330543.517475:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788330543.517480:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792531840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517512:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792531840:12345-0@lo:400:kworker.0 Request processed in 32us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517519:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788330543.517529:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330543.517535:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792532352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517575:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792532352:12345-0@lo:400:kworker.0 Request processed in 40us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517581:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330543.517619:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792531968 00000100:00100000:3.0:1788330543.517623:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792531968 00000100:00100000:3.0:1788330543.517642:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792532480 00000100:00100000:3.0:1788330543.517644:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792532480 00000100:00100000:3.0:1788330543.517653:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792532096 00000100:00100000:3.0:1788330543.517655:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792532096 00000100:00100000:3.0:1788330543.517665:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792532608 00000100:00100000:3.0:1788330543.517668:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792532608 00000100:00100000:3.0:1788330543.517679:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330543.517684:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792531968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517714:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792531968:12345-0@lo:400:kworker.0 Request processed in 30us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517720:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330543.517730:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330543.517736:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792532480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517762:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792532480:12345-0@lo:400:kworker.0 Request processed in 27us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517768:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330543.517779:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330543.517784:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792532096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517811:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792532096:12345-0@lo:400:kworker.0 Request processed in 28us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517817:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330543.517827:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330543.517842:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc65b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792532608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517870:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc65b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792532608:12345-0@lo:400:kworker.0 Request processed in 30us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330543.517876:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788330543.517897:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330543.517901:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330543.517904:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330543.517919:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330543.517953:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792532096:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517964:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792532608:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517972:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792533120:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517982:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792531968:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.517991:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792532480:0@lo:400:kworker.0 00010000:00080000:3.0:1788330543.518003:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec995c700 x1875199792532992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330543.518012:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792532992:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.518062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792531840:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.518072:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792532352:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.518080:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792532864:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.518088:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792531712:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.518098:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792532224:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.518119:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792532736:0@lo:400:kworker.0 00010000:00080000:3.0:1788330543.518128:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec995dc00 x1875199792533248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330543.518137:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792533248:0@lo:400:kworker.0 00000100:00100000:3.0:1788330543.525946:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792533376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330543.526051:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330543.526751:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330543.526764:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792533504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330543.526799:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330543.526830:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792533376 00000100:00100000:0.0:1788330543.526840:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792533376 00000100:00100000:0.0:1788330543.526881:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792533504 00000100:00100000:0.0:1788330543.526884:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792533504 00000100:00100000:0.0:1788330543.526900:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330543.526909:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792533376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330543.526939:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788330543.527002:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792533376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330543.527010:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330543.527031:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330543.527038:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792533504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330543.527059:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788330543.528056:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792533504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1015us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330543.528066:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330543.528126:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792533504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330543.528175:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792533376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788330543.579405:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788330544.333885:0:25695:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff990bca00 20000000:00000080:3.0:1788330544.333911:0:25695:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99eeffb07400 uarg=0000000000000000 20000000:01000000:3.0:1788330544.333956:0:25695:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788330544.333962:0:25695:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788330544.333968:0:25695:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788330544.337536:0:25696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788330544.337705:0:25695:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788330544.346546:0:25695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788330544.346584:0:25695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346605:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346630:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346637:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2aab expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346644:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346653:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346661:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346670:0:25695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346730:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346745:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 12 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.346761:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792533632:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330544.346871:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.346881:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 12 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.347543:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792533760:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330544.347598:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.347607:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 23 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.347616:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792533888:0@lo:104: 00000100:00100000:0.0:1788330544.353508:0:25695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330544.353581:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792533888 00000100:00100000:2.0:1788330544.353593:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792533888 00010000:00010000:0.0:1788330544.353607:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2aab expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.353626:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2aab expref: 23 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.353644:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792534016:0@lo:104: 00000100:00100000:2.0:1788330544.353654:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330544.353665:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:25695:x1875199792533888:12345-0@lo:104: 00010000:00010000:2.0:1788330544.353679:0:22652:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.353691:0:25695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330544.353719:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330544.353768:0:22653:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788330544.353776:0:22653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788330544.353884:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792534016 00000100:00100000:3.0:1788330544.353888:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792534016 00000100:00100000:3.0:1788330544.353971:0:25697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330544.353979:0:25697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:25695:x1875199792534016:12345-0@lo:104: 00010000:00010000:3.0:1788330544.353987:0:25697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.357047:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 23 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.357616:0:22652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330544.357628:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:25695:x1875199792533888:12345-0@lo:104: Request processed in 3963us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330544.357642:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788330544.357690:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330544.357697:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.357706:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79a00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330544.357710:0:25008:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.357721:0:25008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330544.357729:0:25008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330544.357762:0:25008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330544.357818:0:25008:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.357825:0:25008:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330544.357857:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.357864:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e79a00/0x8475908e9fd2c2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2c33 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.357879:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330544.357881:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330544.357882:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330544.357904:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792534272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330544.357972:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330544.358021:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792534272 00000100:00100000:2.0:1788330544.358029:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792534272 00010000:00010000:2.0:1788330544.358070:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 24 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330544.358098:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330544.358107:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3649:x1875199792534272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330544.358118:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330544.358124:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 24 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.358133:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 24 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.358178:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330544.358597:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3649:x1875199792534272:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330544.358609:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330544.358656:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792534272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330544.358821:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792534144:0@lo:104: 00000100:00100000:0.0:1788330544.358861:0:25695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330544.358915:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.358951:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 23 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.358961:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792534400:0@lo:104: 00000100:00100000:0.0:1788330544.358984:0:25695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330544.358998:0:25695:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920c480 going to sleep for 11 seconds 00010000:00010000:0.0:1788330544.359011:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd2c33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2c2c expref: 23 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.359021:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792533888:0@lo:104: 00000100:00100000:2.0:1788330544.361879:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792534144 00000100:00100000:2.0:1788330544.361898:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792534144 00000100:00100000:2.0:1788330544.361947:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792534400 00000100:00100000:2.0:1788330544.361951:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792534400 00000100:00100000:2.0:1788330544.361970:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330544.361979:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+5:25695:x1875199792534144:12345-0@lo:104: 00010000:00010000:2.0:1788330544.362000:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362188:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330544.362195:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+5:25695:x1875199792534144:12345-0@lo:104: Request processed in 217us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330544.362203:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330544.362237:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330544.362244:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:25695:x1875199792534400:12345-0@lo:104: 00010000:00010000:2.0:1788330544.362252:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362296:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788330544.362303:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+4:25695:x1875199792534400:12345-0@lo:104: Request processed in 60us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330544.362330:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330544.362331:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792534144:0@lo:104: 00000100:00100000:0.0:1788330544.362344:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792534400:0@lo:104: 00010000:00010000:2.0:1788330544.362354:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330544.362361:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362369:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065e00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330544.362373:0:22657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362382:0:22657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330544.362389:0:22657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330544.362395:0:22657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330544.362440:0:22657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362447:0:22657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330544.362471:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362477:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02065e00/0x8475908e9fd2a6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a73 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362490:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330544.362493:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362509:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064a00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330544.362512:0:22657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362519:0:22657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330544.362524:0:22657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330544.362530:0:22657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330544.362544:0:22657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362550:0:22657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330544.362557:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362564:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02064a00/0x8475908e9fd2a5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2a65 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.362576:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330544.362578:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330544.362580:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330544.362594:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792534528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330544.362638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330544.362676:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330544.362682:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792534656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330544.362714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330544.363008:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792534528 00000100:00100000:0.0:1788330544.363015:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792534528 00010000:00010000:0.0:1788330544.363051:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 23 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.363087:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792534656 00000100:00100000:0.0:1788330544.363098:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792534656 00010000:00010000:0.0:1788330544.363117:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 24 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.363135:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330544.363142:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3646:x1875199792534528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330544.363170:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330544.363176:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 24 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.363314:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 24 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.363331:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2a73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2a6c expref: 24 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.363348:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330544.363390:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:3646:x1875199792534528:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330544.363396:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330544.363415:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330544.363421:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:3646:x1875199792534656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330544.363429:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330544.363434:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 22 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.363441:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 22 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.363453:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2a65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2a5e expref: 22 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.363460:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330544.363482:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3646:x1875199792534656:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330544.363488:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330544.363882:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792534656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330544.363893:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3646:1875199792534528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330544.365308:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330544.366167:0:25697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330544.366181:0:25697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+3:25695:x1875199792534016:12345-0@lo:104: Request processed in 12198us (12489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330544.366193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330544.366200:0:25697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788330544.366216:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792533632:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330544.366226:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792533760:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330544.366234:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875199792534016:0@lo:104: 00010000:00010000:1.0:1788330544.366269:0:25695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330544.366354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330544.366410:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766195072 00010000:00010000:2.0:1788330544.366413:0:25008:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788330544.366417:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766195072 00010000:00010000:2.0:1788330544.366420:0:25008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.366429:0:25008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330544.366432:0:25008:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.366440:0:25008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330544.366445:0:22654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 13 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330544.366448:0:25008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330544.366454:0:25008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788330544.366479:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766195200 00000100:00100000:1.0:1788330544.366482:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766195200 00010000:00010000:1.0:1788330544.366494:0:22654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 14 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.366498:0:25008:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.366504:0:25008:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788330544.366510:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1788330544.366517:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:573a5691-846f-44eb-9aa6-a19751065277+14:2413:x1875199766195072:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330544.366523:0:25008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330544.366528:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330544.366529:0:25008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd2aab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2ab2 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330544.366534:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 14 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330544.366543:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 14 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.366549:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330544.366555:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9039200/0x8475908e9fd2dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610643f expref: 14 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.366556:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330544.366558:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330544.366568:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330544.366572:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792534784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330544.366627:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:573a5691-846f-44eb-9aa6-a19751065277+13:2413:x1875199766195072:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 109us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330544.366631:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330544.366639:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd349450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:573a5691-846f-44eb-9aa6-a19751065277+13:2413:x1875199766195200:12345-192.168.202.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788330544.366644:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00010000:00010000:3.0:1788330544.366655:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330544.366660:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 12 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330544.366668:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 12 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330544.366678:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeffb92200/0x8475908e9fd2d98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61063cf expref: 12 pid: 22663 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330544.366686:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330544.366874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330544.366926:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792534784 00000100:00100000:2.0:1788330544.366930:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792534784 00010000:00010000:2.0:1788330544.366949:0:23824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2aab expref: 21 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330544.366965:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330544.366972:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:3648:x1875199792534784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330544.366981:0:23824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330544.366986:0:23824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2aab expref: 21 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.366994:0:23824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2aab expref: 21 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367005:0:23824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02065600/0x8475908e9fd2ab2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2aab expref: 21 pid: 22662 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367016:0:23824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367025:0:23824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367052:0:23824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367059:0:23824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367073:0:23824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367079:0:23824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367083:0:23824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330544.367088:0:23824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367095:0:23824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.367108:0:23824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330544.370106:0:23824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330544.370257:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:3648:x1875199792534784:12345-0@lo:103:ldlm_bl.0 Request processed in 3280us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330544.370270:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788330544.370282:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792534784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330544.370327:0:25695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.370340:0:25695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330544.370347:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e08 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330544.370637:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd349450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:573a5691-846f-44eb-9aa6-a19751065277+11:2413:x1875199766195200:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 3994us (4277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330544.370648:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00010000:00010000:2.0:1788330544.603309:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330545.381442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.381503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.381541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.381567:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.381594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.381612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.381651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.381669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.381722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330545.382220:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766195456 00000100:00100000:2.0:1788330545.382235:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766195456 00000100:00100000:3.0:1788330545.382290:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766195968 00000100:00100000:3.0:1788330545.382302:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766195968 00000100:00100000:2.0:1788330545.382321:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766195584 00000100:00100000:2.0:1788330545.382328:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766195584 00000100:00100000:2.0:1788330545.382357:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766196096 00000100:00100000:2.0:1788330545.382361:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766196096 00000100:00100000:3.0:1788330545.382373:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:3.0:1788330545.382391:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2412:x1875199766195456:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330545.382392:0:22668:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788330545.382414:0:22668:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788330545.382467:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766195328 00000100:00100000:2.0:1788330545.382487:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766195328 00000100:00100000:2.0:1788330545.382526:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:2.0:1788330545.382537:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+11:2412:x1875199766195328:12345-192.168.202.50@tcp:400:kworker.0 00000100:00080000:1.0:1788330545.383262:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330545.383270:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330545.383422:0:22669:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788330545.383441:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:1.0:1788330545.383467:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bec507ff-147a-4857-b92c-687ebb3aca56+6:2412:x1875199766195968:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330545.383633:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+11:2412:x1875199766195328:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 1090us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.383644:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:2.0:1788330545.383700:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766195712 00000100:00100000:2.0:1788330545.383707:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766195712 00000100:00100000:2.0:1788330545.383741:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766196224 00000100:00100000:2.0:1788330545.383744:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766196224 00000100:00100000:2.0:1788330545.383758:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766195840 00000100:00100000:2.0:1788330545.383761:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766195840 00000100:00100000:2.0:1788330545.383774:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766196352 00000100:00100000:2.0:1788330545.383777:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766196352 00000100:00100000:2.0:1788330545.383794:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1788330545.383801:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2412:x1875199766195712:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330545.383900:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1788330545.383911:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bec507ff-147a-4857-b92c-687ebb3aca56+5:2412:x1875199766196224:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330545.389939:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2412:x1875199766195456:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 7534us (8493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330545.389960:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:3.0:1788330545.390031:0:22670:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788330545.390610:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:3.0:1788330545.391839:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2412:x1875199766195584:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330545.392872:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bec507ff-147a-4857-b92c-687ebb3aca56+6:2412:x1875199766195968:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 9399us (11319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.392886:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:1.0:1788330545.392934:0:22669:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788330545.392954:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:1.0:1788330545.392970:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bec507ff-147a-4857-b92c-687ebb3aca56+5:2412:x1875199766196096:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330545.393001:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2412:x1875199766195712:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 9185us (11481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.393015:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bec507ff-147a-4857-b92c-687ebb3aca56+5:2412:x1875199766196096:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 50us (11343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.393039:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:1.0:1788330545.393047:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:2.0:1788330545.393103:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:2.0:1788330545.393124:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2412:x1875199766195840:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330545.393224:0:24178:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788330545.393235:0:24178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788330545.393258:0:24176:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788330545.393273:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:0.0:1788330545.393284:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bec507ff-147a-4857-b92c-687ebb3aca56+5:2412:x1875199766196224:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 9368us (11708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.393292:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bec507ff-147a-4857-b92c-687ebb3aca56+5:2412:x1875199766196352:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330545.393329:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bec507ff-147a-4857-b92c-687ebb3aca56+5:2412:x1875199766196352:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 45us (11609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.393335:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:2.0:1788330545.393419:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2412:x1875199766195840:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 302us (11763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.393428:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00080000:2.0:1788330545.393464:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330545.393470:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330545.394216:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:3.0:1788330545.397680:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2412:x1875199766195584:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 7033us (16044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330545.397701:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00010000:00010000:1.0:1788330545.627491:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788330545.691557:0:22666:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330545.691579:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7c0d800 from 13 10000000:01000000:2.0:1788330545.691584:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330545.691632:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038200/0x8475908e9fd2e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.691642:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9038200/0x8475908e9fd2e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.691652:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9038200/0x8475908e9fd2e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330545.691677:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792534912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.691745:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330545.691792:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cae240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330545.691802:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792534912 00000100:00100000:0.0:1788330545.691810:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792534912 00000100:00100000:0.0:1788330545.691866:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788330545.691875:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+20:22666:x1875199792534912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330545.691888:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330545.691903:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2e0f expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.691925:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2e0f expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.691937:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78400/0x8475908e9fd2e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2e0f expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.691969:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78400, rc 0) 00000100:00100000:0.0:1788330545.692018:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792534912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330545.692039:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788330545.692130:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792534912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330545.692144:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9038200/0x8475908e9fd2e0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e16 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.692186:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9038200/0x8475908e9fd2e0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2e16 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330545.692245:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.692265:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330545.692296:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cae240 going to sleep for 11 seconds 00000100:00100000:3.0:1788330545.692315:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792535040 00000100:00100000:3.0:1788330545.692319:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792535040 00000100:00100000:3.0:1788330545.692354:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788330545.692362:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792535040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330545.692479:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792535040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330545.692487:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788330545.694343:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.694408:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.694453:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330545.694488:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788330545.694514:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792535168 00000100:00100000:1.0:1788330545.694520:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792535168 00000100:00100000:1.0:1788330545.694569:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788330545.694578:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792535168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330545.694860:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792535168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.694868:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788330545.695534:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788330545.698014:0:25712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788330545.701122:0:22666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788330545.701218:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330545.701232:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038200/0x8475908e9fd2e0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e16 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.701247:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038200/0x8475908e9fd2e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e16 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330545.701259:0:22666:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330545.701262:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef590d000 from 13 10000000:01000000:2.0:1788330545.701265:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330545.701308:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2e1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.701316:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2e1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.701327:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2e1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330545.701355:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.701429:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330545.701468:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cae240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330545.701810:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792535296 00000100:00100000:0.0:1788330545.701818:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792535296 00000100:00100000:0.0:1788330545.701871:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788330545.701881:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+21:22666:x1875199792535296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330545.701894:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330545.701907:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2e24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2e1d expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.701930:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2e1d expref: 22 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.701952:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78a00/0x8475908e9fd2e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2e1d expref: 22 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.701961:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78a00, rc 0) 00000100:00100000:0.0:1788330545.702015:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:22666:x1875199792535296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330545.702034:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788330545.702209:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330545.702224:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2e1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e24 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.702233:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2e1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2e24 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330545.702305:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.702330:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330545.702352:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788330545.702410:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792535424 00000100:00100000:1.0:1788330545.702415:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792535424 00000100:00100000:1.0:1788330545.702438:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788330545.702445:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec69e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:22666:x1875199792535424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330545.702569:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec69e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:22666:x1875199792535424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.702575:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788330545.702678:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.702703:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.702741:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330545.702765:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788330545.702809:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792535552 00000100:00100000:1.0:1788330545.702813:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792535552 00000100:00100000:1.0:1788330545.702842:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788330545.702847:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:22666:x1875199792535552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330545.702928:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:22666:x1875199792535552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.702934:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788330545.703108:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788330545.704070:0:25713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788330545.704756:0:22666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788330545.704780:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330545.704790:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2e1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e24 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.704801:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2e1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e24 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330545.704812:0:22666:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330545.704815:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7d04000 from 13 10000000:01000000:2.0:1788330545.704817:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330545.704852:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038600/0x8475908e9fd2e2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.704860:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9038600/0x8475908e9fd2e2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.704869:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9038600/0x8475908e9fd2e2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330545.704902:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.705041:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330545.705122:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788330545.710107:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792535680 00000100:00100000:1.0:1788330545.710124:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792535680 00000100:00100000:1.0:1788330545.710317:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788330545.710328:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+22:22666:x1875199792535680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330545.710347:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330545.710381:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eeffb92800/0x8475908e9fd2e32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2e2b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330545.710410:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeffb92800/0x8475908e9fd2e32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2e2b expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330545.710422:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eeffb92800/0x8475908e9fd2e32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2e2b expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330545.710432:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeffb92800, rc 0) 00000100:00100000:1.0:1788330545.710684:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792535680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (5640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.710691:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788330545.710776:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330545.710794:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9038600/0x8475908e9fd2e2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e32 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330545.710803:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9038600/0x8475908e9fd2e2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2e32 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330545.710883:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330545.710924:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330545.711067:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee72009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330545.711101:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792535808 00000100:00100000:2.0:1788330545.711106:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792535808 00000100:00100000:2.0:1788330545.711268:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788330545.711278:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792535808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.711406:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792535808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.711412:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788330545.711466:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330545.712193:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330545.712248:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330545.712509:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee72009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330545.712588:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792535936 00000100:00100000:0.0:1788330545.712596:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792535936 00000100:00100000:0.0:1788330545.712631:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788330545.712639:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792535936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330545.712817:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792535936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330545.712830:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788330545.712923:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec995dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792535936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788330545.713929:0:25714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788330545.714323:0:22666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788330545.714390:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330545.714400:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038600/0x8475908e9fd2e2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e32 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.714411:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038600/0x8475908e9fd2e2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e32 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330545.714421:0:22666:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330545.714424:0:22666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eee7213000 from 13 10000000:01000000:0.0:1788330545.714426:0:22666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330545.714457:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd2e39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.714464:0:22666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd2e39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.714475:0:22666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd2e39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330545.714495:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792536064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330545.714544:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330545.714583:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330545.714634:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792536064 00000100:00100000:2.0:1788330545.714641:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792536064 00000100:00100000:2.0:1788330545.714739:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788330545.714749:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+23:22666:x1875199792536064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330545.714761:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330545.714774:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147b600/0x8475908e9fd2e40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2e39 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.714796:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147b600/0x8475908e9fd2e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2e39 expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.714805:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147b600/0x8475908e9fd2e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2e39 expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.714814:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b600, rc 0) 00000100:00100000:2.0:1788330545.714854:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:22666:x1875199792536064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.714870:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788330545.714952:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792536064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330545.714965:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd2e39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e40 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.714974:0:22666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd2e39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2e40 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330545.715037:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792536192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330545.715060:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330545.715079:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330545.715178:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792536192 00000100:00100000:2.0:1788330545.715182:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792536192 00000100:00100000:2.0:1788330545.715198:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788330545.715204:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:22666:x1875199792536192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.715294:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:22666:x1875199792536192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.715300:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788330545.715427:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792536192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330545.715451:0:22666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792536320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330545.715484:0:22666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330545.715509:0:22666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330545.715551:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792536320 00000100:00100000:2.0:1788330545.715555:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792536320 00000100:00100000:2.0:1788330545.715578:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788330545.715584:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:22666:x1875199792536320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.715658:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:22666:x1875199792536320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.715720:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788330545.715821:0:22666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e95a55f7-77f3-48c4-a98a-95aef9b6d238:22666:1875199792536320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788330545.716759:0:25715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788330545.716967:0:22666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788330545.716987:0:22666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330545.716996:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd2e39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e40 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330545.717007:0:22666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd2e39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2e40 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330545.770619:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330545.770723:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766196480 00000100:00100000:2.0:1788330545.770734:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766196480 00000100:00100000:2.0:1788330545.770794:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:2.0:1788330545.770807:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+11:18083:x1875199766196480:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330545.770825:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330545.770845:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147ae00/0x8475908e9fd2e47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106477 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.770876:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147ae00/0x8475908e9fd2e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106477 expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.770912:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147ae00/0x8475908e9fd2e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106477 expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.770922:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147ae00, rc 0) 00000100:00100000:2.0:1788330545.770994:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+12:18083:x1875199766196480:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 189us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.771002:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:1.0:1788330545.783338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330545.783435:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766196608 00000100:00100000:3.0:1788330545.783460:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766196608 00000100:00100000:3.0:1788330545.783519:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 162 00000100:00100000:3.0:1788330545.783529:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+12:18083:x1875199766196608:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330545.783681:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+12:18083:x1875199766196608:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 153us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330545.783690:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 162 00000100:00100000:0.0:1788330545.788761:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330545.788857:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766196736 00000100:00100000:3.0:1788330545.788869:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766196736 00000100:00100000:3.0:1788330545.788930:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 163 00000100:00100000:3.0:1788330545.788941:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+12:18083:x1875199766196736:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330545.789380:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+12:18083:x1875199766196736:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 439us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330545.789389:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 163 00000100:00100000:1.0:1788330545.804960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330545.806381:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766196864 00000100:00100000:2.0:1788330545.806396:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766196864 00000100:00100000:2.0:1788330545.806466:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 164 00000100:00100000:2.0:1788330545.806477:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+12:18083:x1875199766196864:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330545.806494:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330545.806514:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147b000/0x8475908e9fd2e4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610647e expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.806545:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147b000/0x8475908e9fd2e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610647e expref: 13 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.806557:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147b000/0x8475908e9fd2e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610647e expref: 13 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330545.806567:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b000, rc 0) 00000100:00100000:2.0:1788330545.806632:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:573a5691-846f-44eb-9aa6-a19751065277+13:18083:x1875199766196864:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 157us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.806640:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 164 00000100:00100000:1.0:1788330545.814909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330545.814992:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766196992 00000100:00100000:2.0:1788330545.815014:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766196992 00000100:00100000:2.0:1788330545.815119:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:2.0:1788330545.815129:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+13:18083:x1875199766196992:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330545.815324:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+13:18083:x1875199766196992:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 195us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330545.815332:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:0.0:1788330545.831686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330545.837458:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766197120 00000100:00100000:1.0:1788330545.837474:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766197120 00000100:00100000:1.0:1788330545.837559:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:1.0:1788330545.837570:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+13:18083:x1875199766197120:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330545.837736:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:573a5691-846f-44eb-9aa6-a19751065277+13:18083:x1875199766197120:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 167us (6063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330545.837744:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:3.0:1788330546.076851:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330546.076892:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792536448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330546.077136:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330546.077398:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330546.077408:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792536576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330546.077439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330546.077803:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792536576 00000100:00100000:3.0:1788330546.077811:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792536576 00000100:00100000:3.0:1788330546.077881:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788330546.077891:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792536576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788330546.077932:0:22674:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788330546.077981:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792536576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330546.077987:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788330546.078045:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792536576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330546.084496:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792536448 00000100:00100000:1.0:1788330546.084515:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792536448 00000100:00100000:1.0:1788330546.084675:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330546.084689:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792536448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330546.084740:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330546.084835:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792536448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (7699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330546.084841:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330546.084963:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330546.084977:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792536704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330546.085028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330546.085117:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792536448:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788330546.085801:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330546.085836:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792536704 00000100:00100000:3.0:1788330546.085843:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792536704 00000100:00100000:3.0:1788330546.085907:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330546.085917:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792536704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330546.085944:0:22673:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788330546.085999:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792536704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330546.086006:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330546.086068:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792536704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330546.542201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330546.545351:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766197248 00000100:00100000:3.0:1788330546.545367:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766197248 00000100:00100000:3.0:1788330546.545609:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:3.0:1788330546.545621:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:18708:x1875199766197248:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330546.545643:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330546.545662:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd2e55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106485 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545729:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545743:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545756:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545770:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545793:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545799:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545881:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030e00/0x8475908e9fd2e6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545889:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030e00/0x8475908e9fd2e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545896:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030e00/0x8475908e9fd2e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330546.545929:0:22669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788330546.545932:0:22669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330546.545975:0:22669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030e00/0x8475908e9fd2e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545987:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.545994:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546001:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546007:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0031800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330546.546022:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546037:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546064:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc757f900) 00010000:00010000:3.0:1788330546.546068:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330546.546073:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546079:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd2e5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546096:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546102:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546108:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546113:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0031e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330546.546116:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546121:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546128:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99eecda4db00) 00010000:00010000:3.0:1788330546.546131:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330546.546133:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.546147:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2e63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.547025:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd2e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106485 expref: 8 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.547046:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030e00/0x8475908e9fd2e6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106485 expref: 7 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.547055:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99eecda4da00) 00010000:00010000:3.0:1788330546.547065:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330546.547068:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec0030e00, rc 0) 00000100:00100000:3.0:1788330546.547348:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18708:x1875199766197248:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1728us (5198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330546.547357:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:3.0:1788330546.574695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330546.575091:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766197376 00000100:00100000:0.0:1788330546.575102:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766197376 00000100:00100000:0.0:1788330546.575206:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1788330546.575227:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18708:x1875199766197376:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788330546.575329:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18708:x1875199766197376:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 Request processed in 113us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330546.575337:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1788330546.587437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330546.587604:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766197632 00000100:00100000:1.0:1788330546.587617:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766197632 00000100:00100000:1.0:1788330546.587687:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:1.0:1788330546.587698:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18708:x1875199766197632:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330546.587724:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330546.587751:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2e71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610648c expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.587846:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.587861:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.587875:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.587893:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.587900:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.587907:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.588053:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92600/0x8475908e9fd2e86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.588341:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92600/0x8475908e9fd2e86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.588350:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92600/0x8475908e9fd2e86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330546.588360:0:25709:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788330546.589383:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589398:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589406:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589412:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb93c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330546.589416:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589424:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589551:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99eecda4da00) 00010000:00010000:1.0:1788330546.589554:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330546.589559:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589582:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2e78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589598:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589604:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589609:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589613:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330546.589617:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589621:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589629:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99eec96ef200) 00010000:00010000:1.0:1788330546.589632:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330546.589635:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.589640:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2e7f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.596643:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2e71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610648c expref: 10 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.596672:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92600/0x8475908e9fd2e86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610648c expref: 9 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.596695:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec96ef000) 00010000:00010000:1.0:1788330546.596699:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330546.596702:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeffb92600, rc 0) 00000100:00100000:1.0:1788330546.596786:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:18708:x1875199766197632:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 9089us (9370us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788330546.596795:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:2.0:1788330546.603495:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330546.603608:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766197760 00000100:00100000:0.0:1788330546.603618:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766197760 00000100:00100000:0.0:1788330546.603681:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:0.0:1788330546.603692:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:18708:x1875199766197760:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788330546.603807:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:18708:x1875199766197760:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330546.603815:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:3.0:1788330546.611622:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330546.612036:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766197888 00000100:00100000:0.0:1788330546.612048:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766197888 00000100:00100000:0.0:1788330546.612121:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:0.0:1788330546.612132:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:18708:x1875199766197888:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788330546.615331:0:22670:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3101us 00000100:00100000:2.0:1788330546.639708:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:18708:x1875199766197888:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 27567us (28087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330546.639723:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00010000:00010000:2.0:1788330546.655765:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330546.738003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330546.738208:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766198016 00000100:00100000:0.0:1788330546.738228:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766198016 00000100:00100000:0.0:1788330546.738290:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:0.0:1788330546.738301:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:18714:x1875199766198016:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330546.738321:0:22668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330546.738344:0:22668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd2e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106493 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738404:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738445:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738459:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738519:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738526:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738533:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738581:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738588:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738595:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738600:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330546.738605:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738612:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738622:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc757f900) 00010000:00010000:0.0:1788330546.738630:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330546.738634:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738640:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2e9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738654:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738658:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738663:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738668:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330546.738676:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738680:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738686:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99eec9ea6600) 00010000:00010000:0.0:1788330546.738689:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330546.738691:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738697:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2ea2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738725:0:22668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd2e94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106493 expref: 10 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738743:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc757f900) 00010000:00010000:0.0:1788330546.738746:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330546.738749:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd2e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106493 expref: 10 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330546.738759:0:22668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78200, rc 0) 00000100:00100000:0.0:1788330546.738820:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:18714:x1875199766198016:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 521us (833us total) trans 0 rc 301/301 00000100:00100000:0.0:1788330546.738828:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:2.0:1788330546.770791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330546.770934:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766198144 00000100:00100000:1.0:1788330546.770946:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766198144 00000100:00100000:1.0:1788330546.771021:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:1.0:1788330546.771033:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:18714:x1875199766198144:12345-192.168.202.50@tcp:700:lfs.0 00000100:00100000:1.0:1788330546.771387:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:18714:x1875199766198144:12345-192.168.202.50@tcp:700:lfs.0 Request processed in 355us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330546.771396:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1788330546.779804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330546.780343:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766198400 00000100:00100000:1.0:1788330546.780362:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766198400 00000100:00100000:1.0:1788330546.781317:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:1.0:1788330546.781335:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:18714:x1875199766198400:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:1.0:1788330546.781403:0:25709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330546.781443:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030c00/0x8475908e9fd2dc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106400 expref: 9 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.781465:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc757f900) 00010000:00010000:1.0:1788330546.781471:0:25709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330546.781638:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.781670:0:25709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 5 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.781679:0:25709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.781714:0:25709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 5 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.781728:0:25709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 5 pid: 22670 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330546.781742:0:25709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1875199792536832:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330546.781846:0:25709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70ccf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330546.797739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330546.797824:0:25709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1875199792536832:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330546.797865:0:25709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330546.800249:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766198528 00000100:00100000:3.0:1788330546.800274:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766198528 00010000:00010000:3.0:1788330546.800351:0:23824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 6 pid: 22670 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330546.800419:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1788330546.800432:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bec507ff-147a-4857-b92c-687ebb3aca56+6:2413:x1875199766198528:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330546.800453:0:23824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330546.800486:0:23824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 6 pid: 22670 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.800504:0:23824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 6 pid: 22670 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.800538:0:23824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd2e01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106470 expref: 6 pid: 22670 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.800569:0:23824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc757f900) 00010000:00010000:3.0:1788330546.800576:0:23824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.800588:0:23824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.800596:0:23824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.800637:0:23824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330546.800715:0:25709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.800733:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330546.800738:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bec507ff-147a-4857-b92c-687ebb3aca56+5:2413:x1875199766198528:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 304us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330546.800758:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00010000:00010000:1.0:1788330546.800792:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.800811:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.800837:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805074:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805099:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805112:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330546.805131:0:25709:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ee1dca5 reply state 0000000051374e01 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805143:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805170:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:1.0:1788330546.805173:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788330546.805177:0:25709:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788330546.805183:0:25709:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788330546.805191:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805199:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805205:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805211:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb93200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330546.805223:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805231:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805884:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc757f900) 00010000:00010000:1.0:1788330546.805887:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330546.805891:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805898:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93200/0x8475908e9fd2ea9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330546.805921:0:25709:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ee1dca5 reply state 0000000051374e01 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805930:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330546.805937:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99eec96ef200) 00010000:00010000:1.0:1788330546.805940:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788330546.805943:0:25709:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788330546.806090:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+10:18714:x1875199766198400:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 24756us (26297us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788330546.806101:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:2.0:1788330546.969261:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330546.969546:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766198656 00000100:00100000:3.0:1788330546.969560:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766198656 00000100:00100000:3.0:1788330546.969635:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:3.0:1788330546.969646:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+10:18722:x1875199766198656:12345-192.168.202.50@tcp:101:lctl.0 00010000:00010000:3.0:1788330546.969681:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330546.969824:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd2ebe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610649a expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.969925:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2ec5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.969943:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.969957:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330546.970018:0:22669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788330546.970253:0:22669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330546.970306:0:22669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.970337:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd2ebe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610649a expref: 12 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.970358:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031e00/0x8475908e9fd2ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610649a expref: 11 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330546.970369:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:3.0:1788330546.970372:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330546.970376:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec0031e00, rc 0) 00000100:00100000:3.0:1788330546.970506:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+11:18722:x1875199766198656:12345-192.168.202.50@tcp:101:lctl.0 Request processed in 860us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330546.970515:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000040:00080000:3.0:1788330547.037323:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788330547.046703:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330547.047202:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766198784 00000100:00100000:2.0:1788330547.047217:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766198784 00000100:00100000:2.0:1788330547.047329:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:2.0:1788330547.047345:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec995c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+5:18723:x1875199766198784:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330547.047374:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330547.047402:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2ecc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064a1 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330547.047757:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788330547.047919:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd2ed3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.047937:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd2ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.047954:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd2ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330547.048312:0:22670:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330547.048318:0:22670:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330547.048346:0:22670:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd2ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.048380:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2ecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064a1 expref: 7 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.048405:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd2ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064a1 expref: 6 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.048417:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:2.0:1788330547.048420:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330547.048424:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064000, rc 0) 00000100:00100000:2.0:1788330547.048877:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec995c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+6:18723:x1875199766198784:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1534us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330547.048887:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:0.0:1788330547.063800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330547.065396:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766198912 00000100:00100000:2.0:1788330547.065419:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766198912 00000100:00100000:2.0:1788330547.065530:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:2.0:1788330547.065544:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+6:18723:x1875199766198912:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330547.065574:0:22668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330547.065602:0:22668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064a8 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065692:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065710:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065725:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065738:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065746:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065753:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065878:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2eef lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065888:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2eef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.065896:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2eef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330547.065958:0:22668:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330547.065962:0:22668:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330547.065985:0:22668:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2eef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066000:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066017:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066630:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066640:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330547.066645:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066653:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066671:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:2.0:1788330547.066674:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330547.066684:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066691:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2ee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066707:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066729:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066735:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066740:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330547.066743:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066749:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066758:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99eec96ef200) 00010000:00010000:2.0:1788330547.066761:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330547.066764:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066770:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2ee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066818:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064a8 expref: 8 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066833:0:22668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2eef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064a8 expref: 7 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.066841:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:2.0:1788330547.066844:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330547.066853:0:22668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02065000, rc 0) 00000100:00100000:2.0:1788330547.066959:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+7:18723:x1875199766198912:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1418us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330547.066969:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1788330547.074213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330547.074502:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766199040 00000100:00100000:2.0:1788330547.074515:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766199040 00000100:00100000:2.0:1788330547.074602:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:2.0:1788330547.074618:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bec507ff-147a-4857-b92c-687ebb3aca56+5:18723:x1875199766199040:12345-192.168.202.50@tcp:900:lfs.0 00000100:00100000:2.0:1788330547.074737:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bec507ff-147a-4857-b92c-687ebb3aca56+5:18723:x1875199766199040:12345-192.168.202.50@tcp:900:lfs.0 Request processed in 124us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330547.074746:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00080000:0.0:1788330547.075932:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330547.084667:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.086610:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766199296 00000100:00100000:0.0:1788330547.086644:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766199296 00000100:00100000:0.0:1788330547.086795:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:0.0:1788330547.086809:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bec507ff-147a-4857-b92c-687ebb3aca56+7:18723:x1875199766199296:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330547.086847:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330547.086876:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2ef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064af expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330547.087048:0:25709:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788330547.087240:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2ef6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064af expref: 9 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.087259:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:0.0:1788330547.087279:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330547.087286:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2ef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064af expref: 9 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.087304:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78800, rc 0) 00000100:00100000:0.0:1788330547.087394:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bec507ff-147a-4857-b92c-687ebb3aca56+8:18723:x1875199766199296:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 587us (2743us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788330547.087402:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1788330547.095527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330547.101412:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330547.101445:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792536960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330547.101539:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330547.101659:0:24180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792536960 00000100:00100000:1.0:1788330547.101687:0:24180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792536960 00000100:00100000:1.0:1788330547.105561:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330547.105599:0:24180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792536960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330547.105640:0:24180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330547.105785:0:24180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792536960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330547.105794:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330547.105892:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792536960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330547.105970:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330547.107184:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766199552 00000100:00100000:2.0:1788330547.107198:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766199552 00000100:00100000:2.0:1788330547.107270:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1788330547.107281:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+8:18723:x1875199766199552:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:2.0:1788330547.107348:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330547.107385:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2eef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064a8 expref: 8 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.107411:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:2.0:1788330547.107417:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330547.107447:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.107464:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.107476:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330547.108363:0:22670:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f1a7d8ba reply state 0000000000b41601 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.108382:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.108389:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:2.0:1788330547.108392:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788330547.108395:0:22670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788330547.108404:0:22670:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788330547.108531:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+9:18723:x1875199766199552:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 1249us (13019us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788330547.108540:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:3.0:1788330547.114610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.114798:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766199808 00000100:00100000:0.0:1788330547.114816:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766199808 00000100:00100000:0.0:1788330547.114890:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:0.0:1788330547.114903:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bec507ff-147a-4857-b92c-687ebb3aca56+9:18723:x1875199766199808:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330547.115250:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bec507ff-147a-4857-b92c-687ebb3aca56+10:18723:x1875199766199808:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 349us (656us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788330547.115260:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:2.0:1788330547.141847:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.141991:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766200064 00000100:00100000:0.0:1788330547.142013:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766200064 00000100:00100000:0.0:1788330547.142652:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:0.0:1788330547.142667:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+10:18723:x1875199766200064:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330547.142703:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330547.142732:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064b6 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.142838:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.142859:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.142894:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.142908:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.142916:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.142923:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330547.143749:0:22670:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788330547.143860:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.143870:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.143877:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.143884:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330547.143889:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.143898:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.143916:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:0.0:1788330547.143919:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330547.143935:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.143942:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.143958:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.143964:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.147849:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.147861:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330547.147867:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.147879:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.147904:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99eec96ef200) 00010000:00010000:0.0:1788330547.147908:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330547.147913:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.147921:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.148313:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064b6 expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.148359:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:0.0:1788330547.148361:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330547.148366:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064b6 expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.148378:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78800, rc 0) 00000100:00100000:0.0:1788330547.148786:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bec507ff-147a-4857-b92c-687ebb3aca56+11:18723:x1875199766200064:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 6118us (6960us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788330547.148798:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:1.0:1788330547.167224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330547.167446:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766200192 00000100:00100000:2.0:1788330547.167461:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766200192 00000100:00100000:2.0:1788330547.167548:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:2.0:1788330547.167562:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+11:18723:x1875199766200192:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330547.167602:0:22668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330547.167632:0:22668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f27 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064bd expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.167760:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.167779:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.167792:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330547.167842:0:22668:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330547.167847:0:22668:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330547.167870:0:22668:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.167904:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f27 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 13 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.167927:0:22668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 12 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.167937:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:2.0:1788330547.167940:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330547.167945:0:22668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064a00, rc 0) 00000100:00100000:2.0:1788330547.168050:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bec507ff-147a-4857-b92c-687ebb3aca56+12:18723:x1875199766200192:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 489us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330547.168058:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:1.0:1788330547.173635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.173752:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766200320 00000100:00100000:0.0:1788330547.173768:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766200320 00000100:00100000:0.0:1788330547.173847:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:0.0:1788330547.173860:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bec507ff-147a-4857-b92c-687ebb3aca56+12:18723:x1875199766200320:12345-192.168.202.50@tcp:37:lfs.0 00000100:00100000:0.0:1788330547.182416:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bec507ff-147a-4857-b92c-687ebb3aca56+12:18723:x1875199766200320:12345-192.168.202.50@tcp:37:lfs.0 Request processed in 8542us (8784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330547.182434:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:2.0:1788330547.186954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330547.194497:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766200576 00000100:00100000:1.0:1788330547.194520:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766200576 00000100:00100000:2.0:1788330547.194773:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1788330547.194788:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bec507ff-147a-4857-b92c-687ebb3aca56+12:18723:x1875199766200576:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1788330547.195423:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bec507ff-147a-4857-b92c-687ebb3aca56+13:18723:x1875199766200576:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 634us (8482us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788330547.195434:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000040:00080000:0.0:1788330547.229779:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788330547.287527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.287662:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766200704 00000100:00100000:0.0:1788330547.287677:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766200704 00000100:00100000:0.0:1788330547.287782:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:0.0:1788330547.287795:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+11:18729:x1875199766200704:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330547.287834:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330547.287862:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064c4 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.287978:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.287995:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288038:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288059:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288067:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288075:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288226:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd2f4a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288236:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd2f4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288243:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd2f4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330547.288284:0:25709:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788330547.288288:0:25709:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330547.288335:0:25709:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd2f4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288360:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288367:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288375:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288382:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330547.288386:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288394:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288409:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:0.0:1788330547.288412:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330547.288418:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288424:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288440:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288445:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288451:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288462:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330547.288465:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288471:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288479:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99eec96ef200) 00010000:00010000:0.0:1788330547.288481:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330547.288484:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288490:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288521:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064c4 expref: 13 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288535:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd2f4a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064c4 expref: 12 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.288543:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:0.0:1788330547.288545:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788330547.288547:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78200, rc 0) 00000100:00100000:0.0:1788330547.288633:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+12:18729:x1875199766200704:12345-192.168.202.50@tcp:101:bash.0 Request processed in 840us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330547.288641:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00080000:1.0:1788330547.288798:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330547.292727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330547.292861:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766200832 00000100:00100000:2.0:1788330547.292877:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766200832 00000100:00100000:2.0:1788330547.292984:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1788330547.293023:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:18729:x1875199766200832:12345-192.168.202.50@tcp:900:bash.0 00000100:00080000:1.0:1788330547.293243:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330547.293475:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:18729:x1875199766200832:12345-192.168.202.50@tcp:900:bash.0 Request processed in 455us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330547.293485:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1788330547.302003:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330547.302337:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766201088 00000100:00100000:1.0:1788330547.302351:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766201088 00000100:00100000:1.0:1788330547.302607:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:1.0:1788330547.302622:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+12:18729:x1875199766201088:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330547.302652:0:22668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330547.302679:0:22668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd2f51 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064cb expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.302895:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.302916:0:22668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 12 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.302951:0:22668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.303001:0:22668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 12 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.303029:0:22668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 12 pid: 22668 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330547.303110:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22668:1875199792537088:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330547.303370:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7bb9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330547.306917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330547.307079:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22668:1875199792537088:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330547.307116:0:22668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330547.307665:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766201216 00000100:00100000:0.0:1788330547.307696:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766201216 00010000:00010000:0.0:1788330547.307748:0:22654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 13 pid: 22668 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330547.307849:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:0.0:1788330547.307862:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec507ff-147a-4857-b92c-687ebb3aca56+13:2412:x1875199766201216:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330547.307882:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330547.307890:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 13 pid: 22668 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.307905:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 13 pid: 22668 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.307934:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd2f2e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064bd expref: 13 pid: 22668 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.307955:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:0.0:1788330547.307961:0:22654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.307973:0:22654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.307981:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.308020:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330547.308108:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec507ff-147a-4857-b92c-687ebb3aca56+12:2412:x1875199766201216:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 248us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330547.308126:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00010000:00010000:2.0:1788330547.309289:0:22668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.309304:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.309494:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.309521:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.309535:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310068:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310078:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310085:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330547.310110:0:22668:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788330547.310139:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310146:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310219:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310225:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330547.310239:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310248:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310263:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:2.0:1788330547.310267:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330547.310272:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310279:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92200/0x8475908e9fd2f58 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330547.310295:0:22668:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002e7df66b reply state 00000000ab89887a transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310306:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310322:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99eee75e3400) 00010000:00010000:2.0:1788330547.310324:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330547.310328:0:22668:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788330547.310368:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd2f51 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 15 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310384:0:22668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 14 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330547.310391:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330547.310393:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788330547.310396:0:22668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02065000, rc 0) 00000100:00100000:2.0:1788330547.310488:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+15:18729:x1875199766201088:12345-192.168.202.50@tcp:101:bash.0 Request processed in 7870us (8501us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788330547.310498:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:2.0:1788330547.329875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.330304:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766201344 00000100:00100000:0.0:1788330547.330319:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766201344 00000100:00100000:0.0:1788330547.330396:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:0.0:1788330547.330410:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+15:18729:x1875199766201344:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330547.330447:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330547.330499:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f74 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064d2 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.330627:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f7b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.330645:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.330659:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330547.330721:0:25709:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788330547.330726:0:25709:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330547.330751:0:25709:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.330763:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.330796:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f74 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064d2 expref: 17 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.330819:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f7b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064d2 expref: 16 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.330859:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330547.330863:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330547.330867:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79800, rc 0) 00000100:00100000:0.0:1788330547.330952:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+16:18729:x1875199766201344:12345-192.168.202.50@tcp:101:bash.0 Request processed in 545us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330547.330959:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:1.0:1788330547.342084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.342204:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766201600 00000100:00100000:0.0:1788330547.342225:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766201600 00000100:00100000:0.0:1788330547.342324:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1788330547.342339:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+16:18729:x1875199766201600:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:0.0:1788330547.342777:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+17:18729:x1875199766201600:12345-192.168.202.50@tcp:35:bash.0 Request processed in 441us (703us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788330547.342787:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1788330547.513996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330547.519885:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766201856 00000100:00100000:2.0:1788330547.519902:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766201856 00000100:00100000:3.0:1788330547.522568:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:3.0:1788330547.522595:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+17:18739:x1875199766201856:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330547.522629:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330547.522655:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd2f82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064d9 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330547.522793:0:22669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788330547.522904:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd2f82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064d9 expref: 19 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330547.522919:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:3.0:1788330547.522921:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330547.522927:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd2f82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064d9 expref: 19 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330547.522954:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec0030a00, rc 0) 00000100:00100000:3.0:1788330547.523421:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+18:18739:x1875199766201856:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 838us (9436us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788330547.523430:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:1.0:1788330547.535629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330547.535697:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766202112 00000100:00100000:1.0:1788330547.535707:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766202112 00000100:00100000:1.0:1788330547.535783:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1788330547.535797:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+18:18739:x1875199766202112:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1788330547.536074:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+19:18739:x1875199766202112:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 279us (458us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788330547.536083:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:2.0:1788330547.640517:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.640632:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766202368 00000100:00100000:0.0:1788330547.640643:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766202368 00000100:00100000:0.0:1788330547.640708:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:0.0:1788330547.640719:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+19:18742:x1875199766202368:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330547.640748:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330547.640769:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f90 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064e0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.640896:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f97 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.640913:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f97 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.641104:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f97 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330547.641118:0:25709:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788330547.641289:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2f90 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064e0 expref: 22 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.641310:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f97 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064e0 expref: 21 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330547.641319:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330547.641322:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330547.641325:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78800, rc 0) 00000100:00100000:0.0:1788330547.641384:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+21:18742:x1875199766202368:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 667us (878us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788330547.641392:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:0.0:1788330547.647193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.647241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330547.647339:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766202496 00000100:00100000:1.0:1788330547.647349:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766202496 00000100:00100000:1.0:1788330547.647412:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:1.0:1788330547.647422:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+21:18742:x1875199766202496:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1788330547.647489:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647520:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647532:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647566:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647573:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647579:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647585:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330547.647589:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647597:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647609:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:1.0:1788330547.647612:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330547.647617:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330547.647623:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92a00/0x8475908e9fd2fa5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330547.647761:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766202624 00000100:00100000:3.0:1788330547.647766:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766202624 00000100:00100000:3.0:1788330547.647803:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1788330547.647810:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+22:2411:x1875199766202624:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330547.647828:0:23824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330547.647844:0:23824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2f97 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064e0 expref: 22 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330547.647856:0:23824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:3.0:1788330547.647860:0:23824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330547.648490:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+21:18742:x1875199766202496:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 1066us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330547.648505:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:3.0:1788330547.662296:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+20:2411:x1875199766202624:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 14468us (15036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330547.662316:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:1.0:1788330547.668495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330547.668605:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766202880 00000100:00100000:0.0:1788330547.668615:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766202880 00000100:00100000:0.0:1788330547.668711:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1788330547.668732:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+20:18742:x1875199766202880:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330547.668954:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+21:18742:x1875199766202880:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 234us (470us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788330547.668962:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00010000:00010000:2.0:1788330547.677510:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330548.113425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330548.115229:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766203136 00000100:00100000:0.0:1788330548.115272:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766203136 00000100:00100000:0.0:1788330548.115380:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:0.0:1788330548.115394:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+21:18773:x1875199766203136:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:0.0:1788330548.115441:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330548.115470:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2fac lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064e7 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.115644:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fb3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.115662:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fb3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.115681:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fb3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330548.115694:0:25709:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788330548.115861:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2fac lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064e7 expref: 24 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.115883:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fb3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064e7 expref: 23 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.115891:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330548.115894:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330548.115898:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79a00, rc 0) 00000100:00100000:0.0:1788330548.115991:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+23:18773:x1875199766203136:12345-192.168.202.50@tcp:101:cat.0 Request processed in 600us (2595us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788330548.116009:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:3.0:1788330548.119700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330548.119782:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766203392 00000100:00100000:1.0:1788330548.119798:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766203392 00000100:00100000:1.0:1788330548.119888:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:1.0:1788330548.119902:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+23:18773:x1875199766203392:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:1.0:1788330548.120838:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+24:18773:x1875199766203392:12345-192.168.202.50@tcp:35:cat.0 Request processed in 932us (1148us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788330548.120851:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:2.0:1788330548.139560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330548.144929:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766203520 00000100:00100000:3.0:1788330548.144954:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766203520 00000100:00100000:3.0:1788330548.145576:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:3.0:1788330548.145592:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+24:2411:x1875199766203520:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330548.145614:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330548.145646:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fb3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064e7 expref: 24 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330548.145670:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:3.0:1788330548.145676:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330548.145773:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+23:2411:x1875199766203520:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 186us (6233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330548.145781:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:1.0:1788330548.248135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330548.248751:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766203776 00000100:00100000:0.0:1788330548.248766:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766203776 00000100:00100000:0.0:1788330548.248856:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:0.0:1788330548.248869:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+23:18779:x1875199766203776:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1788330548.248903:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330548.248931:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2fc1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064ee expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.249106:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fc8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.249125:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fc8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.249139:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fc8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330548.249183:0:22669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788330548.249356:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd2fc1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064ee expref: 26 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.249379:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fc8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064ee expref: 25 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.249390:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330548.249393:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330548.249833:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79a00, rc 0) 00000100:00100000:0.0:1788330548.249929:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+25:18779:x1875199766203776:12345-192.168.202.50@tcp:101:dd.0 Request processed in 1061us (1806us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788330548.249958:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:3.0:1788330548.255674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330548.255816:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766203904 00000100:00100000:0.0:1788330548.255830:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766203904 00000100:00100000:0.0:1788330548.255898:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:0.0:1788330548.255910:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+25:18779:x1875199766203904:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1788330548.255943:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330548.255968:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2fd6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064f5 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.256026:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.256044:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.256057:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.256241:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2fd6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 27 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.256265:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 26 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.256274:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330548.256278:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330548.256282:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c2000, rc 0) 00000100:00100000:0.0:1788330548.256360:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+26:18779:x1875199766203904:12345-192.168.202.50@tcp:101:dd.0 Request processed in 451us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330548.256375:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:2.0:1788330548.263291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330548.264064:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766204032 00000100:00100000:3.0:1788330548.264080:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766204032 00000100:00100000:3.0:1788330548.264243:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1788330548.264257:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+26:2410:x1875199766204032:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330548.264275:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330548.264309:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79a00/0x8475908e9fd2fc8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064ee expref: 26 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330548.264333:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:3.0:1788330548.264339:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330548.264606:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+25:2410:x1875199766204032:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 351us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330548.264615:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1788330548.273364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330548.273613:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766204288 00000100:00100000:2.0:1788330548.273630:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766204288 00000100:00100000:2.0:1788330548.273722:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:2.0:1788330548.273739:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+25:18779:x1875199766204288:12345-192.168.202.50@tcp:36:dd.0 00010000:00010000:2.0:1788330548.273861:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330548.273899:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2f7b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064d2 expref: 25 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.273926:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330548.273932:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330548.274244:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.274261:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.274272:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330548.274320:0:22668:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788330548.274346:0:22668:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c216dd01 reply state 00000000c1a4c091 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.274360:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.274366:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330548.274369:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330548.274371:0:22668:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330548.274517:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+27:18779:x1875199766204288:12345-192.168.202.50@tcp:36:dd.0 Request processed in 781us (1170us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788330548.274525:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000020:00080000:2.0:1788330548.274531:0:22668:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788330548.430514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330548.430774:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766204544 00000100:00100000:1.0:1788330548.430787:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766204544 00000100:00100000:1.0:1788330548.430860:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1788330548.430871:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+27:18779:x1875199766204544:12345-192.168.202.50@tcp:35:dd.0 00000100:00100000:1.0:1788330548.431431:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+28:18779:x1875199766204544:12345-192.168.202.50@tcp:35:dd.0 Request processed in 558us (942us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788330548.431442:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:3.0:1788330548.636841:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792537600:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.636959:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.637057:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792538112:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.637100:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792538624:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637128:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.637186:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788330548.637193:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792537216:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.637256:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792537728:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.637295:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792538240:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.637357:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792538752:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.637413:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792538624 00000100:00100000:3.0:1788330548.637422:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792538624 00000100:00100000:3.0:1788330548.637487:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792537728 00000100:00100000:3.0:1788330548.637490:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792537728 00000100:00100000:3.0:1788330548.637504:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792538240 00000100:00100000:3.0:1788330548.637507:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792538240 00000100:00100000:3.0:1788330548.637517:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792538752 00000100:00100000:3.0:1788330548.637519:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792538752 00000100:00100000:3.0:1788330548.637538:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788330548.637550:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792538624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637614:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792538624:12345-0@lo:400:kworker.0 Request processed in 65us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330548.637622:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788330548.637670:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792538624:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637699:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788330548.637705:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792537728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637738:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792537728:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330548.637745:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788330548.637768:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792537728:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637788:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788330548.637794:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792538240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637823:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792538240:12345-0@lo:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330548.637839:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788330548.637861:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792538240:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637878:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788330548.637884:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792538752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.637917:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792538752:12345-0@lo:400:kworker.0 Request processed in 34us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330548.637923:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788330548.637948:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c9c00 x1875199792538752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330548.637960:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792538752:0@lo:400:kworker.0 00000100:00100000:1.0:1788330548.638235:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792537600 00000100:00100000:1.0:1788330548.638241:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792537600 00000100:00100000:1.0:1788330548.638286:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792538112 00000100:00100000:1.0:1788330548.638290:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792538112 00000100:00100000:1.0:1788330548.638317:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330548.638325:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792537600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330548.638370:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792537600:12345-0@lo:400:kworker.0 Request processed in 46us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330548.638377:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330548.638399:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330548.638404:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792538112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330548.638435:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792538112:12345-0@lo:400:kworker.0 Request processed in 31us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330548.638441:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788330548.638458:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330548.638464:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330548.638467:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330548.638657:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792537472:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.638700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330548.638722:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792537984:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.638742:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330548.638754:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792538496:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.638775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330548.638795:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788330548.638801:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792537344:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.638839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330548.638857:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792537856:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.638876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330548.638893:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792538368:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.638913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330548.638936:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792537472 00000100:00100000:2.0:1788330548.638940:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792537472 00000100:00100000:2.0:1788330548.639053:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792537984 00000100:00100000:2.0:1788330548.639057:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792537984 00000100:00100000:2.0:1788330548.639079:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330548.639086:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792537472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639124:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792537472:12345-0@lo:400:kworker.0 Request processed in 38us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330548.639132:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330548.639148:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330548.639179:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792537984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639206:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792537984:12345-0@lo:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330548.639225:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330548.639257:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792537344 00000100:00100000:2.0:1788330548.639261:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792537344 00000100:00100000:2.0:1788330548.639287:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792537856 00000100:00100000:2.0:1788330548.639290:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792537856 00000100:00100000:2.0:1788330548.639303:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788330548.639309:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792537344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639344:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792537344:12345-0@lo:400:kworker.0 Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330548.639350:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788330548.639361:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788330548.639366:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792537856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639391:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792537856:12345-0@lo:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330548.639397:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788330548.639437:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792537344:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639447:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792537856:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639456:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792537472:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639466:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792537984:0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639493:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792538496 00000100:00100000:2.0:1788330548.639497:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792538496 00000100:00100000:2.0:1788330548.639517:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792538368 00000100:00100000:2.0:1788330548.639521:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792538368 00000100:00100000:2.0:1788330548.639534:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788330548.639540:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792538496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639584:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792538496:12345-0@lo:400:kworker.0 Request processed in 43us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330548.639590:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788330548.639603:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788330548.639609:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792538368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330548.639634:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792538368:12345-0@lo:400:kworker.0 Request processed in 25us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330548.639639:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788330548.639663:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792538368:0@lo:400:kworker.0 00010000:00080000:2.0:1788330548.639676:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c8e00 x1875199792538496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330548.639686:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792538496:0@lo:400:kworker.0 00000100:00100000:0.0:1788330548.640013:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792537216 00000100:00100000:0.0:1788330548.640020:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792537216 00000100:00100000:0.0:1788330548.640064:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788330548.640072:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3648:x1875199792537216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330548.640115:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3648:x1875199792537216:12345-0@lo:400:kworker.0 Request processed in 44us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330548.640121:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788330548.640219:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792538880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330548.640250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.640500:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3648:1875199792537216:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.640518:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792537600:0@lo:400:kworker.0 00000100:00100000:3.0:1788330548.640528:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792538112:0@lo:400:kworker.0 00000100:00100000:1.0:1788330548.640629:0:24180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792538880 00000100:00100000:1.0:1788330548.640634:0:24180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792538880 00000100:00100000:1.0:1788330548.640679:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330548.640687:0:24180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792538880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330548.640714:0:24180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788330548.640764:0:24180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792538880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330548.640770:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788330548.640794:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330548.640798:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330548.640801:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330548.641135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792538880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330548.642179:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792539008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330548.642249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330548.643459:0:24180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792539008 00000100:00100000:3.0:1788330548.643475:0:24180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792539008 00000100:00100000:3.0:1788330548.643550:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788330548.643562:0:24180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792539008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330548.643591:0:24180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788330548.657973:0:24180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792539008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14393us (15704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330548.658008:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330548.661952:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792539008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788330548.699574:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330548.739338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330548.739463:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766204672 00000100:00100000:0.0:1788330548.739478:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766204672 00000100:00100000:0.0:1788330548.739565:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:0.0:1788330548.739579:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+28:18793:x1875199766204672:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:0.0:1788330548.739617:0:22668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330548.739647:0:22668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2200/0x8475908e9fd2feb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61064fc expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739750:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739770:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739785:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739798:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739841:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739848:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739946:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2400/0x8475908e9fd3000 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739958:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2400/0x8475908e9fd3000 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.739967:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2400/0x8475908e9fd3000 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330548.740237:0:22668:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788330548.740243:0:22668:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330548.740301:0:22668:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2400/0x8475908e9fd3000 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740318:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2400/0x8475908e9fd3000 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740327:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740335:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740343:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740362:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330548.740367:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740376:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740393:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:0.0:1788330548.740397:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330548.740402:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740409:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd2ff2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740427:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740433:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740439:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740444:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330548.740447:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740454:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740473:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99eee75e3400) 00010000:00010000:0.0:1788330548.740475:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330548.740479:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740485:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3800/0x8475908e9fd2ff9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740520:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2200/0x8475908e9fd2feb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064fc expref: 30 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740536:0:22668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2400/0x8475908e9fd3000 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064fc expref: 29 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330548.740544:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330548.740547:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330548.740549:0:22668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c2400, rc 0) 00000100:00100000:0.0:1788330548.740778:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+29:18793:x1875199766204672:12345-192.168.202.50@tcp:101:stat.0 Request processed in 1201us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330548.740786:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:3.0:1788330548.847223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330548.847465:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766204928 00000100:00100000:2.0:1788330548.847480:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766204928 00000100:00100000:2.0:1788330548.847566:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1788330548.847579:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+29:18799:x1875199766204928:12345-192.168.202.50@tcp:36:truncate.0 00010000:00010000:2.0:1788330548.847653:0:25709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330548.847689:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2400/0x8475908e9fd3000 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064fc expref: 29 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.847715:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330548.847721:0:25709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330548.848296:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.848341:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.848353:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330548.848410:0:25709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:2.0:1788330548.848438:0:25709:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d386b0d1 reply state 0000000080a9a093 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.848453:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330548.848460:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330548.848463:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330548.848466:0:25709:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330548.849049:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+31:18799:x1875199766204928:12345-192.168.202.50@tcp:36:truncate.0 Request processed in 1467us (1836us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788330548.849062:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000020:00080000:2.0:1788330548.849070:0:25709:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788330549.141716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330549.141887:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766205056 00000100:00100000:2.0:1788330549.141903:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766205056 00000100:00100000:2.0:1788330549.142013:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00080000:1.0:1788330549.142248:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330549.142319:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+31:18813:x1875199766205056:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:2.0:1788330549.142357:0:22668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330549.142402:0:22668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd300e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106503 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142609:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142646:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142663:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142677:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142683:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142689:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142806:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142815:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142823:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330549.142880:0:22668:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788330549.142886:0:22668:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330549.142916:0:22668:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142931:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142950:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142956:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142963:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142969:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330549.142974:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.142982:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143008:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:2.0:1788330549.143011:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330549.143017:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143229:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd3015 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143248:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143255:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143262:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143277:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330549.143281:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143287:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143297:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99eee75e3400) 00010000:00010000:2.0:1788330549.143300:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330549.143303:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143309:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd301c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143347:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd300e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 33 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143362:0:22668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 32 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.143370:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330549.143372:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330549.143374:0:22668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326200, rc 0) 00000100:00100000:2.0:1788330549.143905:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+32:18813:x1875199766205056:12345-192.168.202.50@tcp:101:stat.0 Request processed in 1879us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330549.143915:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:0.0:1788330549.313665:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330549.313827:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766205312 00000100:00100000:2.0:1788330549.313856:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766205312 00000100:00100000:2.0:1788330549.313942:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:2.0:1788330549.313955:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+32:18823:x1875199766205312:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330549.314017:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330549.314049:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd302a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610650a expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330549.314207:0:22669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788330549.314344:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd302a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610650a expref: 34 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.314362:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:2.0:1788330549.314365:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330549.314372:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd302a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610650a expref: 34 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.314389:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326c00, rc 0) 00000100:00100000:2.0:1788330549.314468:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+33:18823:x1875199766205312:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 514us (884us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1788330549.314476:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1788330549.321687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330549.322454:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766205568 00000100:00100000:0.0:1788330549.322470:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766205568 00000100:00100000:0.0:1788330549.322565:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:0.0:1788330549.322580:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+33:18823:x1875199766205568:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330549.322909:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+34:18823:x1875199766205568:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 331us (1237us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788330549.322934:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1788330549.450547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330549.450800:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766205824 00000100:00100000:2.0:1788330549.450814:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766205824 00000100:00100000:2.0:1788330549.450896:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:2.0:1788330549.450910:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+34:18829:x1875199766205824:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330549.450943:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330549.450993:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3038 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106511 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.451229:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.451249:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 35 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.451259:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 35 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.451269:0:22670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.451315:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 35 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.451331:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 35 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330549.451348:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22670:1875199792539136:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330549.451476:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 35 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.451503:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 35 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330549.451513:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22670:1875199792539264:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330549.451553:0:22670:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec1359cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330549.459095:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22670:1875199792539136:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330549.459119:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22670:1875199792539264:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330549.459887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330549.459929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330549.460264:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766205952 00000100:00100000:0.0:1788330549.460276:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766205952 00010000:00010000:0.0:1788330549.460327:0:22654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 36 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330549.460376:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766206080 00000100:00100000:0.0:1788330549.460380:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766206080 00010000:00010000:0.0:1788330549.460392:0:22654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 37 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330549.460419:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:0.0:1788330549.460431:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eedfff8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:2412:x1875199766205952:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330549.460451:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330549.460460:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 37 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460477:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 37 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460504:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd3023 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106503 expref: 37 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460525:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330549.460531:0:22654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460568:0:22654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460577:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330549.460660:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eedfff8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+36:2412:x1875199766205952:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 230us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330549.460668:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:0.0:1788330549.460725:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:0.0:1788330549.460733:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+35:2412:x1875199766206080:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330549.460741:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330549.460747:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 35 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460757:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 35 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460769:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd2f66 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064cb expref: 35 pid: 22668 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460782:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330549.460785:0:22654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460793:0:22654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460873:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.460903:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330549.460923:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+34:2412:x1875199766206080:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 192us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330549.460929:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00010000:00010000:2.0:1788330549.462483:0:22670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.462516:0:22670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.462522:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330549.462549:0:22670:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788330549.463731:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3038 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 35 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.463766:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 34 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.463777:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330549.463780:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330549.463784:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326000, rc 0) 00000100:00100000:2.0:1788330549.464642:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+34:18829:x1875199766205824:12345-192.168.202.50@tcp:101:bash.0 Request processed in 13727us (14104us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1788330549.464654:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:2.0:1788330549.470335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330549.470923:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766206336 00000100:00100000:1.0:1788330549.470936:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766206336 00000100:00100000:1.0:1788330549.471082:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:1.0:1788330549.471095:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+34:18829:x1875199766206336:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:1.0:1788330549.473064:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.473096:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.473111:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330549.473191:0:22669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1788330549.473219:0:22669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d3805dd5 reply state 000000000945e548 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.473234:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.473242:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:1.0:1788330549.473246:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788330549.473251:0:22669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788330549.473381:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:18829:x1875199766206336:12345-192.168.202.50@tcp:36:bash.0 Request processed in 2283us (3058us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1788330549.473391:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000020:00080000:1.0:1788330549.473399:0:22669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788330549.476749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330549.477450:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766206464 00000100:00100000:2.0:1788330549.477465:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766206464 00000100:00100000:0.0:1788330549.477566:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:0.0:1788330549.477582:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:18829:x1875199766206464:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330549.477628:0:22668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330549.477657:0:22668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd3054 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106518 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.477737:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd3054 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106518 expref: 38 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.477755:0:22668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd3054 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106518 expref: 38 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.477779:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330549.477783:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330549.477787:0:22668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c2a00, rc 0) 00000100:00100000:0.0:1788330549.477872:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+38:18829:x1875199766206464:12345-192.168.202.50@tcp:101:bash.0 Request processed in 294us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330549.477880:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:3.0:1788330549.502039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330549.502278:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766206592 00000100:00100000:0.0:1788330549.502291:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766206592 00000100:00100000:0.0:1788330549.502374:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:0.0:1788330549.502387:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+38:18829:x1875199766206592:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330549.502437:0:22668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330549.502466:0:22668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd305b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610651f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.502627:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.502647:0:22668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 39 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.502657:0:22668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.502706:0:22668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 39 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.502723:0:22668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 39 pid: 22670 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330549.502739:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22668:1875199792539392:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330549.502854:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec286ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330549.525139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330549.528393:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22668:1875199792539392:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330549.528438:0:22668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330549.531004:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766206720 00000100:00100000:2.0:1788330549.531099:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766206720 00010000:00010000:1.0:1788330549.536965:0:22654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 40 pid: 22670 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330549.537064:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:1.0:1788330549.537079:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+40:2413:x1875199766206720:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330549.537099:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330549.537127:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 40 pid: 22670 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.537143:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 40 pid: 22670 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.537435:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd303f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106511 expref: 40 pid: 22670 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.537460:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:1.0:1788330549.537466:0:22654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.537478:0:22654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.537487:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.537518:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330549.537754:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+39:2413:x1875199766206720:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 676us (12627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330549.537764:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00010000:00010000:0.0:1788330549.537885:0:22668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.537894:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330549.538003:0:22668:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788330549.538008:0:22668:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330549.538045:0:22668:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.538086:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd305b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610651f expref: 39 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.538105:0:22668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610651f expref: 38 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330549.538115:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330549.538118:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330549.538121:0:22668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3600, rc 0) 00000100:00100000:0.0:1788330549.538229:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+38:18829:x1875199766206592:12345-192.168.202.50@tcp:101:bash.0 Request processed in 35844us (36216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330549.538238:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1788330549.543519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330549.544303:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766206976 00000100:00100000:2.0:1788330549.544319:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766206976 00000100:00100000:2.0:1788330549.544411:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:2.0:1788330549.544437:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+38:18829:x1875199766206976:12345-192.168.202.50@tcp:103:bash.0 00010000:00010000:2.0:1788330549.544459:0:23824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788330549.544495:0:23824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2a00/0x8475908e9fd3054 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106518 expref: 38 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.544523:0:23824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3600/0x8475908e9fd3062 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610651f expref: 37 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.544535:0:23824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330549.544541:0:23824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330549.544831:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+36:18829:x1875199766206976:12345-192.168.202.50@tcp:103:bash.0 Request processed in 407us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330549.544840:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1788330549.549800:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330549.549999:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766207104 00000100:00100000:2.0:1788330549.550013:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766207104 00000100:00100000:2.0:1788330549.550100:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:2.0:1788330549.550113:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+36:18829:x1875199766207104:12345-192.168.202.50@tcp:58:bash.0 00010000:00010000:2.0:1788330549.550303:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.550327:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330549.550343:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330549.555645:0:22670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330549.555687:0:22670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788330549.555865:0:22670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788330549.556041:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+36:18829:x1875199766207104:12345-192.168.202.50@tcp:58:bash.0 Request processed in 5921us (6260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330549.556057:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:3.0:1788330549.560438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330549.563229:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766207232 00000100:00100000:1.0:1788330549.563253:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766207232 00000100:00100000:1.0:1788330549.563360:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:1.0:1788330549.563373:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+36:18829:x1875199766207232:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330549.563413:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330549.563445:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106526 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.563547:0:22669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.563560:0:22669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106526 expref: 37 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.563586:0:22669:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.563601:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106526 expref: 37 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.563619:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:1.0:1788330549.563622:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330549.563626:0:22669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106526 expref: 37 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330549.563635:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeffb93e00, rc 0) 00000100:00100000:1.0:1788330549.563941:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:18829:x1875199766207232:12345-192.168.202.50@tcp:101:bash.0 Request processed in 568us (3515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330549.563949:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00010000:00010000:2.0:1788330549.725766:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330550.114992:0:22703:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788330550.115009:0:22703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330550.115054:0:22703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788330550.115067:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788330550.115549:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22703:1875199792539520:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788330550.115675:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330550.128073:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22703:1875199792539520:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788330550.131662:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.131840:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766207360 00000100:00100000:2.0:1788330550.131854:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766207360 00000100:00100000:2.0:1788330550.131937:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:2.0:1788330550.131951:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:18830:x1875199766207360:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788330550.132310:0:25709:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788330550.132552:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:18830:x1875199766207360:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 604us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330550.132561:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:3.0:1788330550.155655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.155846:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766207488 00000100:00100000:0.0:1788330550.155861:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766207488 00000100:00100000:0.0:1788330550.155944:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:0.0:1788330550.155957:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:18830:x1875199766207488:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788330550.156087:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156109:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156139:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156389:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156412:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156426:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156458:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156469:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156476:0:22668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330550.156909:0:22668:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788330550.156914:0:22668:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330550.156935:0:22668:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156949:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156956:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156963:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.156998:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330550.157004:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157010:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157024:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec96ef000) 00010000:00010000:0.0:1788330550.157027:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330550.157032:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157039:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd3077 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157057:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157063:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157069:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157074:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330550.157076:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157082:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157101:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff99eec9ea6600) 00010000:00010000:0.0:1788330550.157104:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330550.157108:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157115:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3200/0x8475908e9fd307e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157132:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157139:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157145:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157225:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330550.157228:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157235:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157243:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:0.0:1788330550.157245:0:22668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330550.157248:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.157254:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd3085 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.157366:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:18830:x1875199766207488:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 1407us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.157377:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1788330550.162934:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.163181:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766207744 00000100:00100000:2.0:1788330550.163195:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766207744 00000100:00100000:2.0:1788330550.163271:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:2.0:1788330550.163284:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+37:18830:x1875199766207744:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330550.163314:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330550.163341:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd308c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610652d expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163506:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163525:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163541:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330550.163555:0:22670:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788330550.163881:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163890:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163898:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163905:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330550.163910:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163918:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163933:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330550.163936:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330550.163941:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.163959:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd3093 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.164285:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd308c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610652d expref: 39 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.164297:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec96ef000) 00010000:00010000:2.0:1788330550.164300:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330550.164304:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd308c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610652d expref: 39 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.164314:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326e00, rc 0) 00000100:00100000:2.0:1788330550.164411:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+38:18830:x1875199766207744:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1129us (1493us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1788330550.164420:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:0.0:1788330550.172939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.173081:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766207872 00000100:00100000:1.0:1788330550.173096:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766207872 00000100:00100000:1.0:1788330550.173220:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:1.0:1788330550.173232:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+38:18830:x1875199766207872:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788330550.173285:0:22669:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788330550.173484:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+38:18830:x1875199766207872:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 253us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330550.173492:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:0.0:1788330550.191261:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.191377:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766208128 00000100:00100000:3.0:1788330550.191391:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766208128 00000100:00100000:3.0:1788330550.191471:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:3.0:1788330550.191484:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+38:18830:x1875199766208128:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330550.191513:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330550.191541:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd30a1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106534 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330550.192080:0:22670:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:3.0:1788330550.192103:0:22670:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1788330550.192126:0:22670:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:3.0:1788330550.192358:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd30a8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.192376:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd30a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.192389:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd30a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.192447:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0030a00/0x8475908e9fd30a1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106534 expref: 41 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.192468:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd30a8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106534 expref: 40 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.192477:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eecda4df00) 00010000:00010000:3.0:1788330550.192481:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330550.192484:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec0031800, rc 0) 00000100:00100000:3.0:1788330550.192556:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+40:18830:x1875199766208128:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1075us (1311us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1788330550.192563:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:3.0:1788330550.205604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.209203:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766208384 00000100:00100000:1.0:1788330550.209227:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766208384 00000100:00100000:1.0:1788330550.209322:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:1.0:1788330550.209336:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+40:18830:x1875199766208384:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788330550.209420:0:22669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330550.209460:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031800/0x8475908e9fd30a8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106534 expref: 40 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209488:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eecda4df00) 00010000:00010000:1.0:1788330550.209502:0:22669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330550.209536:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209554:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209565:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209593:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209601:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209607:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209690:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209698:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209705:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209712:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330550.209716:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209725:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209735:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:1.0:1788330550.209739:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330550.209743:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209750:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92e00/0x8475908e9fd30b6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209759:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209766:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209772:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209784:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330550.209787:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209793:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209802:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x2501f893 (ffff99eec96efa00) 00010000:00010000:1.0:1788330550.209805:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330550.209808:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.209813:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30bd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2501f893 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330550.209935:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+39:18830:x1875199766208384:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 600us (4361us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788330550.209943:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:1.0:1788330550.218649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.218814:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766208512 00000100:00100000:0.0:1788330550.218828:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766208512 00000100:00100000:0.0:1788330550.218910:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:0.0:1788330550.218923:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+39:18830:x1875199766208512:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330550.218950:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330550.218988:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30c4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610653b expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.219037:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd30cb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.219054:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd30cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.219068:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd30cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.219261:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30c4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610653b expref: 41 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.219283:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3c00/0x8475908e9fd30cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610653b expref: 40 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.219306:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:0.0:1788330550.219310:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330550.219315:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3c00, rc 0) 00000100:00100000:0.0:1788330550.219404:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+40:18830:x1875199766208512:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 482us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.219412:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:3.0:1788330550.227760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.227925:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766208768 00000100:00100000:1.0:1788330550.227940:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766208768 00000100:00100000:1.0:1788330550.228039:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:1.0:1788330550.228053:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+40:18830:x1875199766208768:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788330550.228211:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.228235:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.228276:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330550.228512:0:22669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1788330550.228525:0:22669:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754200373257ns, next at 755200369605ns, rc = 0 00000004:00010000:1.0:1788330550.228607:0:22669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000047c84c43 reply state 00000000de10e450 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.228624:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.228634:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:1.0:1788330550.228637:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788330550.228642:0:22669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788330550.228767:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+42:18830:x1875199766208768:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 715us (1022us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788330550.228776:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:1.0:1788330550.236751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.241835:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766208896 00000100:00100000:0.0:1788330550.241859:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766208896 00000100:00100000:0.0:1788330550.241964:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:0.0:1788330550.241993:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+42:18830:x1875199766208896:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330550.242036:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330550.242064:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106542 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.242166:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 43 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.242184:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 43 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.242206:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:0.0:1788330550.242209:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330550.242214:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3e00, rc 0) 00000100:00100000:0.0:1788330550.242311:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+43:18830:x1875199766208896:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 336us (5577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.242338:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:2.0:1788330550.247742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.248723:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766209024 00000100:00100000:0.0:1788330550.248742:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766209024 00000100:00100000:0.0:1788330550.248856:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1788330550.248872:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2413:x1875199766209024:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788330550.249402:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2413:x1875199766209024:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 531us (1673us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788330550.249411:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00080000:1.0:1788330550.250111:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330550.260401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.260738:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766209280 00000100:00100000:0.0:1788330550.260752:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766209280 00000100:00100000:0.0:1788330550.260831:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1788330550.260845:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+43:18830:x1875199766209280:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788330550.261375:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+44:18830:x1875199766209280:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 530us (989us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788330550.261384:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:3.0:1788330550.265451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.265704:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766209536 00000100:00100000:1.0:1788330550.265715:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766209536 00000100:00100000:1.0:1788330550.265796:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:1.0:1788330550.265809:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+44:18830:x1875199766209536:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788330550.265957:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+44:18830:x1875199766209536:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 150us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330550.265965:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:1.0:1788330550.275758:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.275934:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766209664 00000100:00100000:0.0:1788330550.275948:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766209664 00000100:00100000:0.0:1788330550.276046:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:0.0:1788330550.276059:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+44:18830:x1875199766209664:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330550.276086:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330550.276113:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2c00/0x8475908e9fd30e0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106549 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.276270:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3a00/0x8475908e9fd30e7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.276314:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3a00/0x8475908e9fd30e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.276329:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3a00/0x8475908e9fd30e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330550.276391:0:22670:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330550.276416:0:22670:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3a00/0x8475908e9fd30e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.276451:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2c00/0x8475908e9fd30e0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106549 expref: 46 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.276472:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3a00/0x8475908e9fd30e7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106549 expref: 45 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.276482:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:0.0:1788330550.276485:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788330550.276489:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3a00, rc 0) 00000100:00100000:0.0:1788330550.276566:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+45:18830:x1875199766209664:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 509us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.276573:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:3.0:1788330550.292013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.293231:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766209792 00000100:00100000:1.0:1788330550.293248:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766209792 00000100:00100000:1.0:1788330550.293335:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:1.0:1788330550.293349:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2412:x1875199766209792:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330550.293375:0:24177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330550.293404:0:24177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106550 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330550.293437:0:24177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c236, blocks: 0x0 00010000:00010000:1.0:1788330550.293466:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788330550.293472:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330550.293485:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 7 pid: 24177 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.293508:0:24177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 7 pid: 24177 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.293526:0:24177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeffb93200, rc 0) 00000100:00100000:1.0:1788330550.293627:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:2412:x1875199766209792:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 281us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330550.293635:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:1.0:1788330550.308947:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.309136:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766210048 00000100:00100000:2.0:1788330550.309188:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766210048 00000100:00100000:2.0:1788330550.309263:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:2.0:1788330550.309276:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+45:18830:x1875199766210048:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788330550.309432:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+45:18830:x1875199766210048:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 158us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330550.309441:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:1.0:1788330550.326419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.326553:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766210176 00000100:00100000:0.0:1788330550.326567:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766210176 00000100:00100000:0.0:1788330550.326664:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:0.0:1788330550.326678:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+45:18830:x1875199766210176:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788330550.339437:0:22649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1788330550.339466:0:22649:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788330550.339549:0:22649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1788330550.339970:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+20:18830:x1875199766210176:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 13286us (13559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.340001:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:2.0:1788330550.341904:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792539648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788330550.342012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330550.342444:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.342479:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.342487:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.342494:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330550.342500:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.342509:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.342530:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:1.0:1788330550.342533:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788330550.342539:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.342544:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065600/0x8475908e9fd2f04 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.342626:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792539648 00000100:00100000:0.0:1788330550.342637:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792539648 00010000:00010000:3.0:1788330550.343093:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343114:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343120:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343126:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330550.343129:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343136:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343196:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99eec96ef200) 00010000:00010000:3.0:1788330550.343199:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330550.343203:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343209:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92400/0x8475908e9fd2eb0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343229:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343235:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343240:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343245:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb93c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330550.343254:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343261:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343270:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:3.0:1788330550.343273:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330550.343276:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343283:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93c00/0x8475908e9fd2eb7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343296:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343302:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343308:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343312:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330550.343315:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343321:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343329:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99eee75e3400) 00010000:00010000:3.0:1788330550.343331:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330550.343340:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343347:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065e00/0x8475908e9fd2f5f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343362:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343368:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343374:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343378:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330550.343381:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343386:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343394:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:3.0:1788330550.343396:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330550.343398:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343404:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064200/0x8475908e9fd2fe4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343416:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343421:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343434:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343439:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330550.343442:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343447:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343454:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:3.0:1788330550.343456:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330550.343458:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343463:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064a00/0x8475908e9fd3007 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343472:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343478:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343484:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343488:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb93000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330550.343491:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343504:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343512:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:3.0:1788330550.343514:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330550.343516:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343522:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93000/0x8475908e9fd304d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343533:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343539:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343544:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343548:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb92c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330550.343551:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343555:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343560:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:3.0:1788330550.343561:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788330550.343563:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.343575:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb92c00/0x8475908e9fd30d2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.343672:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330550.344010:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792539648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788330550.344234:0:24176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788330550.344238:0:24176:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788330550.344240:0:24176:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788330550.344243:0:24176:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788330550 -> 1788330550 00002000:00010000:0.0:1788330550.344246:0:24176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788330550.344345:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792539648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 662us (2332us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788330550.344353:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788330550.344466:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788330550.345314:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99edc7db3800/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788330550.345328:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792539648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788330550.349303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.349401:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766210304 00000100:00100000:1.0:1788330550.349414:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766210304 00000100:00100000:1.0:1788330550.349483:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:1.0:1788330550.349496:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:2411:x1875199766210304:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788330550.349659:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:2411:x1875199766210304:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 155us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330550.349667:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:0.0:1788330550.359843:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.360056:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766210560 00000100:00100000:2.0:1788330550.360070:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766210560 00000100:00100000:2.0:1788330550.360195:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:2.0:1788330550.360208:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+14:18830:x1875199766210560:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788330550.360283:0:22669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330550.360319:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3a00/0x8475908e9fd30e7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106549 expref: 14 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.360343:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:2.0:1788330550.360349:0:22669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330550.360390:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd30f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.360406:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd30f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.360417:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd30f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330550.360585:0:22669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002cf57409 reply state 0000000038cc5568 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd30f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.360599:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd30f5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.360604:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:2.0:1788330550.360607:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330550.360628:0:22669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330550.360768:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+15:18830:x1875199766210560:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 562us (939us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788330550.360776:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:3.0:1788330550.367055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.368856:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766210688 00000100:00100000:2.0:1788330550.368877:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766210688 00000100:00100000:2.0:1788330550.368983:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:2.0:1788330550.368996:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18830:x1875199766210688:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330550.369021:0:25710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330550.369050:0:25710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106557 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.369095:0:25710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 8 pid: 24177 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.369106:0:25710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330550.369111:0:25710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330550.369117:0:25710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 8 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.369210:0:25710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 8 pid: 24177 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.369226:0:25710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 8 pid: 24177 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330550.369243:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25710:1875199792539776:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330550.369376:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330550.375663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.375827:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766210816 00000100:00100000:0.0:1788330550.375841:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766210816 00010000:00010000:0.0:1788330550.375899:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 9 pid: 24177 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.375955:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330550.375966:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:2412:x1875199766210816:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330550.375995:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330550.376033:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 9 pid: 24177 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.376051:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 9 pid: 24177 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.376105:0:22655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330550.376110:0:22655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330550.376128:0:22655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 9 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.376140:0:22655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 9 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.378836:0:22655:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 9 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.378862:0:22655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22655:1875199792539904:192.168.202.50@tcp:105: 00000100:00100000:0.0:1788330550.379014:0:22655:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788330550.382214:0:25710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f92d8c/0x8475908e9fd30ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106550 expref: 9 pid: 24177 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330550.382246:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25710:1875199792539776:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330550.382291:0:25710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 8 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.382310:0:25710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327a00, rc 0) 00000100:00100000:2.0:1788330550.382395:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+8:18830:x1875199766210688:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 13400us (15761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330550.382406:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:1.0:1788330550.386598:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.387107:0:22655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22655:1875199792539904:192.168.202.50@tcp:105: 00010000:00010000:0.0:1788330550.387456:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330550.387543:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:2412:x1875199766210816:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 11576us (11904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.387557:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:2.0:1788330550.388209:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766210944 00000100:00100000:2.0:1788330550.388221:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766210944 00000100:00100000:2.0:1788330550.388280:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:2.0:1788330550.388292:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:2413:x1875199766210944:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788330550.388521:0:24662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788330550.388524:0:24662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788330549 00002000:00010000:2.0:1788330550.388527:0:24662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788330547 00002000:00010000:2.0:1788330550.388530:0:24662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788330550 -> 1788330549 00002000:00010000:2.0:1788330550.388533:0:24662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788330550.388576:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+8:2413:x1875199766210944:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 285us (2002us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788330550.388583:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:1.0:1788330550.401396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.401513:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766211072 00000100:00100000:0.0:1788330550.401529:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766211072 00000100:00100000:0.0:1788330550.401616:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:0.0:1788330550.401629:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+8:2413:x1875199766211072:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788330550.401693:0:24177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.401739:0:24177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 8 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.401750:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330550.401755:0:24177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330550.401762:0:24177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.401811:0:24177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 8 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.401828:0:24177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 8 pid: 25710 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.401846:0:24177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24177:1875199792540032:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330550.401952:0:24177:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330550.405593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.405776:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766211200 00000100:00100000:1.0:1788330550.405788:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766211200 00010000:00010000:1.0:1788330550.405843:0:23824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 9 pid: 25710 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330550.405890:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1788330550.405902:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:2413:x1875199766211200:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330550.405920:0:23824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330550.405948:0:23824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 9 pid: 25710 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.405963:0:23824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 9 pid: 25710 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.406006:0:23824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330550.406016:0:23824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330550.406024:0:23824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.406036:0:23824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.406062:0:23824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330550.406139:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+9:2413:x1875199766211200:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 238us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330550.406203:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00010000:00010000:0.0:1788330550.406623:0:24177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f66ee759/0x8475908e9fd30fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106557 expref: 8 pid: 25710 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.406640:0:24177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24177:1875199792540032:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330550.406663:0:24177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406676:0:24177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406691:0:24177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406716:0:24177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406726:0:24177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406735:0:24177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406742:0:24177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330550.406747:0:24177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406757:0:24177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406772:0:24177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.406780:0:24177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1783d12/0x8475908e9fd3103 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.406855:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:2413:x1875199766211072:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 5230us (5475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.406865:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:0.0:1788330550.414783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.414882:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766211456 00000100:00100000:3.0:1788330550.414896:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766211456 00000100:00100000:3.0:1788330550.414972:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:3.0:1788330550.414994:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+15:18830:x1875199766211456:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788330550.415110:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.415145:0:25709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 15 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330550.415463:0:25709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.415777:0:25709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 15 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.415827:0:25709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 15 pid: 25709 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330550.415846:0:25709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1875199792540160:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330550.415984:0:25709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330550.421066:0:25709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1875199792540160:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330550.421307:0:25709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330550.422312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.422425:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766211584 00000100:00100000:1.0:1788330550.422438:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766211584 00010000:00010000:1.0:1788330550.422499:0:22654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 16 pid: 25709 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330550.422548:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:1.0:1788330550.422561:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+16:2412:x1875199766211584:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330550.422592:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330550.422600:0:22654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 16 pid: 25709 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.422615:0:22654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 16 pid: 25709 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.422642:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2000/0x8475908e9fd2fdd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61064f5 expref: 16 pid: 25709 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.422662:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:1.0:1788330550.422668:0:22654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106526 expref: 15 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.422681:0:22654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.422688:0:22654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.422719:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.422879:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330550.422968:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+15:2412:x1875199766211584:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 409us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330550.422987:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00010000:00010000:2.0:1788330550.423305:0:25709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.423315:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.424441:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.424463:0:25709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 15 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.424472:0:25709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.424520:0:25709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 15 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.424537:0:25709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 15 pid: 22670 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330550.424562:0:25709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1875199792540288:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330550.424676:0:25709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330550.430102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.430226:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766211712 00000100:00100000:1.0:1788330550.430241:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766211712 00010000:00010000:1.0:1788330550.430294:0:23824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 16 pid: 22670 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330550.430349:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:1.0:1788330550.430362:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eedfff9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+16:2413:x1875199766211712:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330550.430381:0:23824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330550.430389:0:23824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 16 pid: 22670 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.430406:0:23824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 16 pid: 22670 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.430436:0:23824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:1.0:1788330550.430442:0:23824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.430454:0:23824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.430485:0:23824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.430511:0:23824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330550.430597:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eedfff9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+16:2413:x1875199766211712:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 238us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330550.430605:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00010000:00010000:2.0:1788330550.431381:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3e00/0x8475908e9fd30d9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106542 expref: 15 pid: 22670 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330550.431404:0:25709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1875199792540288:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330550.431431:0:25709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.431441:0:25709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.431447:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330550.431670:0:25709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1788330550.431812:0:25709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1788330550.431854:0:25709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1788330550.431954:0:25709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25709:1875199792540416:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788330550.432041:0:25709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330550.432082:0:25709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4039600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330550.432356:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792540416 00000100:00100000:0.0:1788330550.432365:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792540416 00000100:00100000:0.0:1788330550.432422:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788330550.432432:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:25709:x1875199792540416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788330550.432548:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:25709:x1875199792540416:12345-0@lo:1000:mdt00_003.0 Request processed in 118us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.432557:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788330550.432970:0:25709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25709:1875199792540416:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788330550.433362:0:25709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1788330550.433441:0:25709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25709:1875199792540544:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788330550.433506:0:25709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330550.433535:0:25709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330550.433698:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792540544 00000100:00100000:2.0:1788330550.433704:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792540544 00000100:00100000:2.0:1788330550.433743:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788330550.433752:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:25709:x1875199792540544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788330550.434078:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:25709:x1875199792540544:12345-0@lo:1000:mdt00_003.0 Request processed in 155us (400us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788330550.434096:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788330550.439682:0:25709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25709:1875199792540544:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788330550.440027:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440039:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440349:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440357:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330550.440362:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440368:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440400:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:1.0:1788330550.440402:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330550.440406:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440410:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd3111 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440440:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440444:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440448:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440451:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330550.440453:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440456:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440461:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:1.0:1788330550.440462:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330550.440468:0:25709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106526 expref: 18 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440477:0:25709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106526 expref: 18 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440489:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106526 expref: 18 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.440546:0:25709:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93e00/0x8475908e9fd3070 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106526 expref: 18 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330550.440557:0:25709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1875199792540672:192.168.202.50@tcp:105: 00000100:00100000:1.0:1788330550.444037:0:25709:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec1377240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330550.446807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.446921:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766211840 00000100:00100000:2.0:1788330550.446933:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766211840 00000100:00100000:2.0:1788330550.447007:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1788330550.447213:0:25709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1875199792540672:192.168.202.50@tcp:105: 00010000:00010000:1.0:1788330550.447255:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447268:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd3069 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447312:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447330:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447344:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447355:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447361:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447386:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447391:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeffb93600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330550.447395:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447404:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447418:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:1.0:1788330550.447421:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330550.447425:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447430:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeffb93600/0x8475908e9fd3118 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447441:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447446:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447452:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447457:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0031000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330550.447459:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447475:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447483:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:1.0:1788330550.447486:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330550.447489:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330550.447494:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec0031000/0x8475908e9fd310a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330550.447726:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+19:18830:x1875199766211456:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 32733us (32959us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1788330550.447738:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00000020:00080000:1.0:1788330550.447745:0:25709:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788330550.447950:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+18:18829:x1875199766211840:12345-192.168.202.50@tcp:49:bash.0 00000100:00100000:2.0:1788330550.448097:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+18:18829:x1875199766211840:12345-192.168.202.50@tcp:49:bash.0 Request processed in 150us (1305us total) trans 0 rc 0/0 00000040:00080000:3.0:1788330550.448287:0:22703:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788330550.448294:0:22703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330550.448312:0:22703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788330550.448318:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788330550.449368:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:3.0:1788330550.453669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.453791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.455543:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766212224 00000100:00100000:2.0:1788330550.455565:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766212224 00000100:00100000:2.0:1788330550.455652:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:2.0:1788330550.455665:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+7:18829:x1875199766212224:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330550.455691:0:25710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330550.455720:0:25710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd311f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610655e expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330550.455754:0:25710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a97c235, atime: 0x6a97c233, ctime: 0x6a97c235, blocks: 0x0 00010000:00010000:2.0:1788330550.455783:0:25710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788330550.455787:0:25710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330550.455797:0:25710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd311f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610655e expref: 8 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.455820:0:25710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd311f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610655e expref: 8 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.455860:0:25710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326800, rc 0) 00000100:00100000:2.0:1788330550.455957:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+8:18829:x1875199766212224:12345-192.168.202.50@tcp:101:bash.0 Request processed in 295us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330550.455963:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1788330550.456655:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766212096 00000100:00100000:0.0:1788330550.456670:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766212096 00000100:00100000:0.0:1788330550.456719:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:0.0:1788330550.456729:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+18:18830:x1875199766212096:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788330550.457094:0:22672:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788330550.457245:0:22672:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1788330550.457280:0:22672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.457297:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.457324:0:22672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.457333:0:22672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.457339:0:22672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.457345:0:22672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330550.457371:0:22672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788330550.457465:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+20:18830:x1875199766212096:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 737us (3812us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1788330550.457473:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000020:00080000:0.0:1788330550.457479:0:22672:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788330550.457705:0:22657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330550.457714:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.457722:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330550.457726:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.457734:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.457750:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99eec9ea6600) 00010000:00010000:2.0:1788330550.457753:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788330550.457759:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.457764:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd3126 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.457778:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330550.457780:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330550.457781:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330550.458741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.458881:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766212352 00000100:00100000:2.0:1788330550.458892:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766212352 00000100:00100000:2.0:1788330550.458958:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:2.0:1788330550.458997:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+20:18829:x1875199766212352:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330550.459027:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330550.459048:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd312d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106565 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.459089:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd3134 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.459102:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd3134 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.459113:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd3134 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.459277:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd312d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106565 expref: 22 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.459299:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd3134 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106565 expref: 21 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.459309:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330550.459312:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330550.459316:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327800, rc 0) 00000100:00100000:2.0:1788330550.459384:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+21:18829:x1875199766212352:12345-192.168.202.50@tcp:101:bash.0 Request processed in 389us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330550.459391:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:1.0:1788330550.470932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.473509:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766212608 00000100:00100000:2.0:1788330550.473535:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766212608 00000100:00100000:2.0:1788330550.473754:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:2.0:1788330550.473787:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+21:18829:x1875199766212608:12345-192.168.202.50@tcp:35:bash.0 00000001:00080000:2.0:1788330550.476412:0:22671:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1788330550.476547:0:22671:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1788330550.477961:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+24:18829:x1875199766212608:12345-192.168.202.50@tcp:35:bash.0 Request processed in 4166us (7033us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1788330550.477989:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000020:00080000:2.0:1788330550.477998:0:22671:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788330550.507595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.507649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.507691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.507711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.507744:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.507775:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766213248 00000100:00100000:3.0:1788330550.507787:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766213248 00000100:00080000:3.0:1788330550.507835:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330550.507888:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766212864 00000100:00100000:3.0:1788330550.507892:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766212864 00000100:00080000:3.0:1788330550.507907:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330550.507932:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:3.0:1788330550.507945:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bec507ff-147a-4857-b92c-687ebb3aca56+5:2413:x1875199766213248:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330550.508069:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bec507ff-147a-4857-b92c-687ebb3aca56+5:2413:x1875199766213248:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 125us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330550.508078:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:3.0:1788330550.508821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.508961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330550.508999:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766213120 00000100:00100000:3.0:1788330550.509005:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766213120 00000100:00080000:3.0:1788330550.509037:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330550.509064:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:3.0:1788330550.509072:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2413:x1875199766212864:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330550.509132:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2413:x1875199766212864:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 48us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330550.509139:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:3.0:1788330550.509190:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:3.0:1788330550.509197:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bec507ff-147a-4857-b92c-687ebb3aca56+6:2413:x1875199766213120:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330550.509234:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bec507ff-147a-4857-b92c-687ebb3aca56+6:2413:x1875199766213120:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 37us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330550.509240:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:0.0:1788330550.511094:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766212992 00000100:00100000:0.0:1788330550.511114:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766212992 00000100:00100000:0.0:1788330550.511207:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766213504 00000100:00100000:0.0:1788330550.511212:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766213504 00000100:00100000:0.0:1788330550.511243:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766213376 00000100:00100000:0.0:1788330550.511246:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766213376 00000100:00100000:0.0:1788330550.511269:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1788330550.511279:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2413:x1875199766212992:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330550.511369:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+5:2413:x1875199766212992:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 91us (3719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.511377:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1788330550.511397:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:0.0:1788330550.511422:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bec507ff-147a-4857-b92c-687ebb3aca56+5:2413:x1875199766213504:12345-192.168.202.50@tcp:400:kworker.0 00000100:00080000:3.0:1788330550.511441:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330550.511447:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330550.511450:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bec507ff-147a-4857-b92c-687ebb3aca56+5:2413:x1875199766213504:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (3739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.511456:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:0.0:1788330550.511468:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:0.0:1788330550.511475:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bec507ff-147a-4857-b92c-687ebb3aca56+5:2413:x1875199766213376:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330550.511501:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bec507ff-147a-4857-b92c-687ebb3aca56+5:2413:x1875199766213376:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330550.511507:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1788330550.511677:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766212736 00000100:00100000:2.0:1788330550.511683:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766212736 00000100:00100000:2.0:1788330550.511726:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:2.0:1788330550.511735:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe82b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+13:2413:x1875199766212736:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330550.511777:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe82b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:573a5691-846f-44eb-9aa6-a19751065277+13:2413:x1875199766212736:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 45us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330550.511783:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:3.0:1788330550.592909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330550.593000:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766213760 00000100:00100000:1.0:1788330550.593319:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766213760 00000100:00100000:2.0:1788330550.593658:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:2.0:1788330550.593674:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+24:18840:x1875199766213760:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330550.593711:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330550.593742:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd313b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610656c expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330550.593878:0:25709:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788330550.594461:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd313b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610656c expref: 26 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.594482:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4db00) 00010000:00010000:2.0:1788330550.594535:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330550.594561:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd313b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610656c expref: 26 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.594581:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327e00, rc 0) 00000100:00100000:2.0:1788330550.594685:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+25:18840:x1875199766213760:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1014us (1788us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1788330550.594694:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:0.0:1788330550.605343:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330550.605437:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766213888 00000100:00100000:2.0:1788330550.605450:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766213888 00000100:00100000:2.0:1788330550.605537:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:2.0:1788330550.605550:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+25:18840:x1875199766213888:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1788330550.605658:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605679:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605692:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605708:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605715:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605722:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605817:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605843:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605851:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330550.605906:0:22670:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605921:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605928:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605936:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605941:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330550.605946:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605953:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605967:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99eec96ef500) 00010000:00010000:2.0:1788330550.605971:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330550.605986:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.605994:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd3149 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606015:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606022:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606028:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606033:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330550.606036:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606042:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606049:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99eee75e3a00) 00010000:00010000:2.0:1788330550.606051:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330550.606053:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606059:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd3150 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606073:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606078:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606084:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606093:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330550.606096:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606102:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606108:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99eee75e3f00) 00010000:00010000:2.0:1788330550.606110:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330550.606113:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330550.606118:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd3157 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330550.606254:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+25:18840:x1875199766213888:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 705us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330550.606262:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:2.0:1788330550.610786:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330550.610875:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766214144 00000100:00100000:0.0:1788330550.610889:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766214144 00000100:00100000:0.0:1788330550.610965:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:0.0:1788330550.610987:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+25:18840:x1875199766214144:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330550.611351:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+26:18840:x1875199766214144:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 374us (773us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1788330550.611360:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00010000:00010000:1.0:1788330550.748927:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330551.196099:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330551.196139:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792540928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330551.196257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330551.196322:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792540928 00000100:00100000:1.0:1788330551.196332:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792540928 00000100:00100000:1.0:1788330551.196407:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330551.196419:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792540928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330551.196459:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330551.196531:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792540928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330551.196557:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330551.196616:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792540928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330551.196982:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792540800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330551.197036:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788330551.197085:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330551.197396:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330551.197409:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792541056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330551.197446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330551.197481:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792540800 00000100:00100000:2.0:1788330551.197496:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792540800 00000100:00100000:2.0:1788330551.197536:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792541056 00000100:00100000:2.0:1788330551.197540:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792541056 00000100:00100000:2.0:1788330551.197558:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330551.197566:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792540800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330551.197600:0:22674:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788330551.197649:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792540800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330551.197657:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330551.197782:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788330551.197790:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792541056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330551.197811:0:22674:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330551.197847:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792541056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330551.197854:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788330551.197890:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792541056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330551.197980:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792540800:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788330551.323940:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788330551.772716:0:25008:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330552.219339:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330552.219361:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792541184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330552.219439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330552.219501:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792541184 00000100:00100000:1.0:1788330552.219509:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792541184 00000100:00100000:1.0:1788330552.219569:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330552.219580:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792541184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330552.219605:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330552.219654:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792541184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330552.219662:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788330552.219685:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330552.219721:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792541184:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788330552.729456:0:25753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788330552.810493:0:22657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330553.578275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330553.578326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330553.578474:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766214272 00000100:00100000:2.0:1788330553.578484:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766214272 00002000:00100000:2.0:1788330553.578549:0:24181:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff99eef6ea0e00 x1875199766214272/t0(0) o4->f3cbf004-e5fc-4428-b2d0-a61ae201f1da@192.168.202.50@tcp:569/0 lens 504/0 e 0 to 0 dl 1788330564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788330553.578560:0:24181:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eef6ea0e00 with x1875199766214272 ext(0->8) 00002000:00010000:2.0:1788330553.578565:0:24181:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99eef6ea0e00 00000100:00100000:2.0:1788330553.578599:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1788330553.578608:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+8:2412:x1875199766214272:12345-192.168.202.50@tcp:4:bash.0 00000100:00080000:1.0:1788330553.578942:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330553.581959:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766214400 00000100:00100000:0.0:1788330553.581974:0:24178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766214400 00000100:00100000:0.0:1788330553.582051:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:0.0:1788330553.582063:0:24178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+11:2412:x1875199766214400:12345-192.168.202.50@tcp:16:kworker.0 00000100:00100000:2.0:1788330553.582279:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+11:2412:x1875199766214272:12345-192.168.202.50@tcp:4:bash.0 Request processed in 3662us (4005us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788330553.582296:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00002000:00100000:2.0:1788330553.582312:0:24181:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff99eef6ea0e00 x1875199766214272/t12884901895(0) o4->f3cbf004-e5fc-4428-b2d0-a61ae201f1da@192.168.202.50@tcp:569/0 lens 504/448 e 0 to 0 dl 1788330564 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788330553.582346:0:24181:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eef6ea0e00 with x1875199766214272 ext(0->8) 00002000:00010000:2.0:1788330553.582354:0:24181:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99eef6ea0e00 00000001:00080000:3.0:1788330553.605270:0:24990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1788330553.605293:0:24990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000100:00100000:0.0:1788330553.605568:0:24178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbf004-e5fc-4428-b2d0-a61ae201f1da+6:2412:x1875199766214400:12345-192.168.202.50@tcp:16:kworker.0 Request processed in 23496us (27230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.605601:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1788330553.755784:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792541312:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.755889:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.755937:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec43c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792541824:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.755988:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756009:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792542336:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756034:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756049:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792542848:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756078:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756118:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788330553.756125:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792541696:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756193:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756215:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756230:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792542720:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756251:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756276:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792541568:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756317:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792542080:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756356:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792542592:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756389:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788330553.756395:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792541440:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756421:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756438:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792541952:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756494:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792542464:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330553.756550:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792541312 00000100:00100000:1.0:1788330553.756560:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792541312 00000100:00100000:1.0:1788330553.756615:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788330553.756626:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3649:x1875199792541312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756689:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e95a55f7-77f3-48c4-a98a-95aef9b6d238+24:3649:x1875199792541312:12345-0@lo:400:kworker.0 Request processed in 64us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330553.756705:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788330553.756749:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792541696 00000100:00100000:1.0:1788330553.756753:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792541696 00000100:00100000:1.0:1788330553.756789:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792542208 00000100:00100000:1.0:1788330553.756792:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792542208 00000100:00100000:1.0:1788330553.756807:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792541568 00000100:00100000:1.0:1788330553.756809:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792541568 00000100:00100000:1.0:1788330553.756820:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792542080 00000100:00100000:1.0:1788330553.756823:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792542080 00000100:00100000:1.0:1788330553.756853:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788330553.756860:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792541696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756897:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792541696:12345-0@lo:400:kworker.0 Request processed in 38us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330553.756903:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788330553.756916:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788330553.756922:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792542208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.756958:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792542208:12345-0@lo:400:kworker.0 Request processed in 36us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330553.756964:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788330553.756974:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788330553.756981:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792541568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.757013:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792541568:12345-0@lo:400:kworker.0 Request processed in 33us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330553.757019:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788330553.757030:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788330553.757037:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792542080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.757077:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792542080:12345-0@lo:400:kworker.0 Request processed in 40us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330553.757083:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788330553.757125:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330553.757131:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330553.757191:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792541568:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.757202:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792542080:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.757233:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1788330553.757239:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99edc7db3800, transno 12884901892 00000004:00080000:1.0:1788330553.757250:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1788330553.757270:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792541696:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.757281:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788330553.757291:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e95a55f7-77f3-48c4-a98a-95aef9b6d238:3649:1875199792541312:0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.757464:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792541824 00000100:00100000:0.0:1788330553.757470:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792541824 00000100:00100000:0.0:1788330553.757498:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792542336 00000100:00100000:0.0:1788330553.757502:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792542336 00000100:00100000:0.0:1788330553.757511:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792542848 00000100:00100000:0.0:1788330553.757514:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792542848 00000100:00100000:0.0:1788330553.757545:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792542720 00000100:00100000:0.0:1788330553.757548:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792542720 00000100:00100000:0.0:1788330553.757563:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792542592 00000100:00100000:0.0:1788330553.757565:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792542592 00000100:00100000:0.0:1788330553.757578:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792542464 00000100:00100000:0.0:1788330553.757581:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792542464 00000100:00100000:0.0:1788330553.757596:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788330553.757603:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792541824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.757674:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792541824:12345-0@lo:400:kworker.0 Request processed in 71us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.757682:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788330553.757698:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788330553.757704:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792542336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.757732:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792542336:12345-0@lo:400:kworker.0 Request processed in 29us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.757738:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788330553.757749:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788330553.757755:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792542848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.757782:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792542848:12345-0@lo:400:kworker.0 Request processed in 28us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.757798:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788330553.757810:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330553.757817:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792542720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.757849:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792542720:12345-0@lo:400:kworker.0 Request processed in 33us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.757854:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330553.757865:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330553.757871:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792542592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.757903:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792542592:12345-0@lo:400:kworker.0 Request processed in 32us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.757908:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330553.757918:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330553.757923:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792542464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.757965:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792542464:12345-0@lo:400:kworker.0 Request processed in 42us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.757971:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330553.758005:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792541440 00000100:00100000:0.0:1788330553.758009:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792541440 00000100:00100000:0.0:1788330553.758038:0:23671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792541952 00000100:00100000:0.0:1788330553.758041:0:23671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792541952 00000100:00100000:0.0:1788330553.758053:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788330553.758059:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792541440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.758094:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792541440:12345-0@lo:400:kworker.0 Request processed in 35us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.758101:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788330553.758123:0:23671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788330553.758130:0:23671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec43dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792541952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.758209:0:23671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec43dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792541952:12345-0@lo:400:kworker.0 Request processed in 79us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330553.758215:0:23671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788330553.758422:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792541440:0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.758434:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792541952:0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.758446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792542464:0@lo:400:kworker.0 00010000:00080000:0.0:1788330553.758462:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7642a00 x1875199792542592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330553.758473:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792542592:0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.758518:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792542720:0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.758531:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec43c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792541824:0@lo:400:kworker.0 00000100:00100000:0.0:1788330553.758543:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792542336:0@lo:400:kworker.0 00010000:00080000:0.0:1788330553.758560:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7641180 x1875199792542848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330553.758570:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792542848:0@lo:400:kworker.0 00000100:00100000:2.0:1788330553.759146:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792542976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330553.759232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330553.759313:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792542976 00000100:00100000:2.0:1788330553.759319:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792542976 00000100:00100000:2.0:1788330553.759361:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330553.759369:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792542976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330553.759394:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3915849728 avail 3684298752 00000100:00100000:2.0:1788330553.759440:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792542976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330553.759447:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330553.759490:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792542976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330553.764975:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330553.765009:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792543104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330553.765113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330553.765223:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792543104 00000100:00100000:2.0:1788330553.765233:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792543104 00000100:00100000:2.0:1788330553.765298:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788330553.765309:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792543104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330553.765337:0:24179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3915849728 avail 3684298752 00000100:00100000:2.0:1788330553.765389:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792543104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330553.765397:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788330553.765474:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792543104:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788330553.767191:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330553.767205:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788330553.828386:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14816 lines, 14816 kept, 0 dropped, 0 bad.